-- Logs begin at Mon 2022-07-11 13:20:52 UTC, end at Mon 2022-07-11 14:36:07 UTC. -- Jul 11 13:52:59.931490 dv-cinder-848429-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 13:52:59.946393 dv-cinder-848429-3-smb devstack@keystone.service[80385]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 13:52:59 2022] *** Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: nodename: dv-cinder-848429-3-smb Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: machine: x86_64 Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: clock source: unix Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: pcre jit disabled Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: detected number of CPU cores: 4 Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: current working directory: / Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: detected binary path: /usr/bin/uwsgi-core Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: your processes number limit is 47680 Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: your memory page size is 4096 bytes Jul 11 13:52:59.949516 dv-cinder-848429-3-smb devstack@keystone.service[80385]: detected max file descriptor number: 2048 Jul 11 13:52:59.951004 dv-cinder-848429-3-smb devstack@keystone.service[80385]: lock engine: pthread robust mutexes Jul 11 13:52:59.951004 dv-cinder-848429-3-smb devstack@keystone.service[80385]: thunder lock: enabled Jul 11 13:52:59.951004 dv-cinder-848429-3-smb devstack@keystone.service[80385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 13:52:59.951004 dv-cinder-848429-3-smb devstack@keystone.service[80385]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: Python main interpreter initialized at 0x560af35319c0 Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: python threads support enabled Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: your server socket listen backlog is limited to 100 connections Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: your mercy for graceful operations on workers is 90 seconds Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: *** Operational MODE: preforking *** Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: *** uWSGI is running in multiple interpreter mode *** Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: spawned uWSGI master process (pid: 80385) Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: spawned uWSGI worker 1 (pid: 80399, cores: 1) Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: spawned uWSGI worker 2 (pid: 80400, cores: 1) Jul 11 13:53:00.022406 dv-cinder-848429-3-smb devstack@keystone.service[80385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 13:52:59.998251 dv-cinder-848429-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 11 13:53:05.747020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:53:05.747020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: from cryptography.utils import int_from_bytes Jul 11 13:53:05.748451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:53:05.748451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Jul 11 13:53:05.749103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:53:05.749103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: from cryptography.utils import int_from_bytes Jul 11 13:53:05.749318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:53:05.749318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Jul 11 13:53:05.800346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:53:05.800611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:53:05.800737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] command line args: [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:53:05.801060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:53:05.801206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ================================================================================ {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:53:05.801429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] admin_token = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.801696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] config_dir = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.801974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.802113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] config_source = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.802232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] debug = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.802507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.804475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:53:05.804628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.804756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:53:05.804868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.804868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.805081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] command line args: [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:53:05.805189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.805189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.805400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:53:05.805519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_config_append = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ================================================================================ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:53:05.806245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_dir = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_file = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.806900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_dir = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_source = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] debug = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.807799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.808948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_config_append = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_dir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.809454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.810220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.810411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.810894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] publish_errors = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.811801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.812116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.812240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.813447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.813747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.813873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] standard_threads = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.813873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] use_journal = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.814796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] use_json = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.815048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.815282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] use_stderr = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.815282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] use_syslog = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.815573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.815930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.816074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.816215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.816215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.816442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.816578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.816699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.816827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.816827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.817038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.817156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.817156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.817156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.817614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.817735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.817878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] publish_errors = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.818006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.818354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.818722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.818968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.818968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.819184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.819317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.819438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.819554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.819554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.819785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] standard_threads = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.819915 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.820042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.820168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.820168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.820393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.820513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.820638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.820771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.820912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_journal = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.821041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.821174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_json = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.821299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.821425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_stderr = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.821564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.821804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_syslog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.822083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.822083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.822372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:53:05.822517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.822517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.822778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.822914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.823924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.824772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.825957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.826934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.827699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.828836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.829957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.830821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.831996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.832835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.833958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.834987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.835875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.836910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.837991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.838992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.external = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.password = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.839977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] auth.token = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.840973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.841956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.842939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.843797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.844838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.845898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.846887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.847936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.848869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.849916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.850932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.851860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.852852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.853901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.854897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.855991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.856961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.857892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.858890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.859051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.external = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.859175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.859854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.859990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.860134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.860414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.860544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.860675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.860808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.password = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.token = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.861971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.862952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.863910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.864917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.865950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.866921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.867948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.868908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.869929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] role.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] role.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.870911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.871960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.872310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.872497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.872619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.872779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.872903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.873858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.874099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.874237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.874434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.874569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.874675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.875783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.875916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.876981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.877960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.878976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.879938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.880889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.881830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.882910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.connection = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.883946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.884967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.885874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.886888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.887876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.888035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.888150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.888225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:53:05.888489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.888795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.889102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.889394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.889742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.890053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.890361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.890693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.891181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.891503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.891917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.892218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.892513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.892828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.893147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.893446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.893789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.894082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.894376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.894750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.895135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.895434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.895749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.896127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.896437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.896737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.897028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.897326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.897663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.897971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.898269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.898591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.898900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.899216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.899604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.899995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.900306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.900663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.900999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.901363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.901847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.902237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.902675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.903058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.903443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.903895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.904309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.904735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.905167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.905695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.906052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.906568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.907022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.908251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.908251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.908251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.908595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.908824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.909132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.909453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.909804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.910114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.910434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.910812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.911180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.911529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.911887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.912230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.912598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.912959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.913325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.913720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.914083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.914451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.914811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.915169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.915520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.915877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.916235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.916592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.916949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.917488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.917871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.918245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.918604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.918966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.919323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.919669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.920038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.920184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.920407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.920551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.920688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.920880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.921194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.921498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.922378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.922693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.923018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.923357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.923663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.923964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.924261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.924566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.924868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.925180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.925481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.925847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.926160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.926461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.926770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.927082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.927393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.927688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.927988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.928289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.928599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.928920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.929216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.929519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.929908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.930146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.930236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.930562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.930873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.931176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.931478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.931771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.932072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.932369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.932672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.932981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.933278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.933625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.933932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.934245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.934552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.934860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.935150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.935455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.935786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:53:05.936049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:53:05.960927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.961233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.964996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.965208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.965436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.975445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.994955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:05.995288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.112420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.130614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.166131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.166405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.169294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.169659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.237466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.237732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.237863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.237976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.238901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.265997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.266969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.267675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.279484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.279903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.294148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.294402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.294555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.294701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.294840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.295931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.296065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:53:06.314315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.314618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:53:06.314957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.315159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.315309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:53:06.315485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:53:06.315632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.315769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:53:06.315915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.316891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.317154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.327892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.328234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.328510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.328790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.329378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.329997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.330475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.330969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.337425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.340878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.341160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.341440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.341750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.342033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.342294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.342560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.342837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.343106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.343377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.344217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.347971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.354767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.355282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.355766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.356471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.356954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.357452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.357964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.358444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.358938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.360033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.360526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.372351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.374044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.374325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.380349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.380644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.380927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.388758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.389034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.394445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.394735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.395021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.395301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.395576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.395871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.396142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.396409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.415497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.415845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.416334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.419528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.420024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.420432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.424251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.424548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.429826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.430599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.431104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.431575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.433487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.437198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.438318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.438487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.438951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.439245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.439537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.447694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.448189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.458799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.459310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.459785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.459911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.460162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.460287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.460414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.460676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.460805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.461229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.461750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.462231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.468810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.470665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.470940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.474612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.474897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.475175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.475458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.475733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.490447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.490756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.491007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.491285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.491559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.491839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.492111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.495321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.495622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.501310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.505265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.505605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.510924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.513812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.514726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.517864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.519504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.519810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.520154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.520556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.520714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.520996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.521237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.522908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.524713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.525007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.525282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.533513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.535225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.538508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.538797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.539081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.539351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.541051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.541455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.541772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.542043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.549438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.549755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.550035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.550936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.552731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.553007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.556150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.556427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.556709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.556991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.557264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.558065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.558350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.558633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.558907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.559169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.559449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.559718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.559997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.560365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.560649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.560929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.561188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.561447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.561754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.572084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.572376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.572779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.572979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.573268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.573566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.573867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.593972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.597370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.600809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.601023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560af35319c0 pid: 80400 (default app) Jul 11 13:53:06.602501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.604154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.604466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.604657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9b80-8052-45a3-8058-7ab79167ce06 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:06.604831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.605029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9b80-8052-45a3-8058-7ab79167ce06 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:06.605187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9b80-8052-45a3-8058-7ab79167ce06 None None] PATH_INFO: `/v3` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:06.610149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Mon Jul 11 13:53:06 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:06.613403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.615122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.618782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.619083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.619365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.619641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.630651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.630878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.631118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.639430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:53:06.639729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.640012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.640289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.641263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.641562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.641871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.642143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.642413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.642681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.642954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.643227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.643488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.643756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:53:06.683440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560af35319c0 pid: 80399 (default app) Jul 11 13:53:16.119420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:16.198788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:16.198788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:16.198788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:16.199243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:16.199243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:16.199243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:16.208602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: INFO dbcounter [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] Registered counter for database keystone Jul 11 13:53:16.232373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:53:16.239829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writer thread running {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:53:16.433083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 13:53:16.433499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 13:53:16.491453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:16.493054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:16.632284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 13:53:16.827380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:16.907825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: INFO dbcounter [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] Registered counter for database keystone Jul 11 13:53:16.929454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG oslo_db.sqlalchemy.engines [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:53:16.936801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writer thread running {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:53:17.069476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8acca-9acc-4954-a74f-c91606e00ff4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:17.074613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:17.075309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:17.075646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:17.075931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:17.086498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:17.143802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 13:53:17.144517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0eae6a-f96d-4fcf-b208-e761a2b7a73e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:17.156895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Jul 11 13:53:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 13:53:17.163391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:17.181692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abf30-b896-4f98-a97f-9edb541a5e26 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:17.186134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:17.187285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:17.187577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:17.187850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] PATH_INFO: `/v3/projects/860ed82bdecd4cd588b102fbafc7b011` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:17.189495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=860ed82bdecd4cd588b102fbafc7b011)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:17.243054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 13:53:17.243724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ae07-448e-41f8-a2eb-c2326987c5a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:17.248460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 2/5] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Jul 11 13:53:17 2022] GET /identity/v3/projects/860ed82bdecd4cd588b102fbafc7b011 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:19.505136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb8c-adb7-47b9-84af-bad193cf23c1 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:19.505846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb8c-adb7-47b9-84af-bad193cf23c1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:19.505846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb8c-adb7-47b9-84af-bad193cf23c1 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:19.509902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 4/6] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:19.516640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:19.517252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:19.517403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:19.538090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:19.539720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:19.548806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 13:53:19.573063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5fb8c-adb7-47b9-84af-bad193cf23c1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:19.586058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5fb8c-adb7-47b9-84af-bad193cf23c1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:19.590446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:19.591124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:19.591394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:19.591682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:19.601387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:19.603329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8172f-71cf-4a74-9708-fa781b156834 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:19.614377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Jul 11 13:53:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 13:53:19.620508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:19.631078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54f5d-a8c9-4951-a876-02361a5c7345 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:19.635641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:19.636543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:19.636832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:19.637108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:19.638644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:19.640835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f444d8-6cdf-41dc-94f7-31df199e1a05 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:19.642680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 4/9] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Jul 11 13:53:19 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:21.872890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff8789-6710-4fe8-aed8-09421832d2fc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:21.873786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff8789-6710-4fe8-aed8-09421832d2fc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:21.873927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff8789-6710-4fe8-aed8-09421832d2fc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:21.876130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:21.883571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:21.884176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:21.884500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:21.913922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:21.915927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:21.977371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78830-e1c2-46e1-bd34-339056786774 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:21.977906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78830-e1c2-46e1-bd34-339056786774 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:21.978392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78830-e1c2-46e1-bd34-339056786774 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:21.980686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 7/11] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:21.990314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:21.990785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:21.991259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.036545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:22.069380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG passlib.handlers.bcrypt [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80400) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 13:53:22.070164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG passlib.handlers.bcrypt [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80400) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 13:53:22.078273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.115812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:22.121566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:22.124119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:22.220335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f77ba4-962b-47fe-9a8a-751e7d38622c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.261977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:22.278908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.279883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.280258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.280656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.285877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.297927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:22.309775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:22.311348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:22.313103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 6/14] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:22.318261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.417625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a2f39-9c00-4d4a-b565-b4213ad6051a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.420417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:22.441571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:22.467962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3980-a2e4-4647-b453-b55a45260f85 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.477071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.478738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.479305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.479804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.515842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.516910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.517195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.517468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.518324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:22.518631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:22.520091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:22.535012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 7/15] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:22.541014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.609074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:22.611601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:22.671738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3936cf-ee87-4a1a-9176-3d75bcb549f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.717199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160085a9-404e-45c1-a022-38245febf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.718658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160085a9-404e-45c1-a022-38245febf34b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.719190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160085a9-404e-45c1-a022-38245febf34b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.719519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160085a9-404e-45c1-a022-38245febf34b None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.720980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160085a9-404e-45c1-a022-38245febf34b None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:22.722695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160085a9-404e-45c1-a022-38245febf34b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:22.724470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 8/16] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:22.730216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160085a9-404e-45c1-a022-38245febf34b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.748850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:22.757406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 9/17] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:53:22.766048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.770287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:22.863283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160085a9-404e-45c1-a022-38245febf34b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.910398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ec2a-c0f3-4cb1-af13-996d86b20b6e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:22.920173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.920998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.921995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.922886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.924831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:22.926391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:22.928094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:22.936426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:22.963009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:22.964444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:22.964967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:22.965466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:22.997906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:22.999655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:53:23.025993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:23.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:23.028253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:53:23.028253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:53:23.028253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:53:23.028253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:23.028253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:23.035591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:23.043015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:23.078244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d399-9b84-419f-b3b4-a1fd3fcb9a4d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:23.103289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:23.133794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:23.134734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:23.135085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:23.135430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:23.136477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.domain.id=default, user.id=2bcd8937417c4772a105e4b213816e7a) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:23.136943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:23.138825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c3a47-cb09-4506-8a7c-7e6111afb2f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:23.149421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1322 bytes} [Mon Jul 11 13:53:22 2022] GET /identity/v3/role_assignments?user.id=2bcd8937417c4772a105e4b213816e7a&scope.domain.id=default&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 233 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:23.155259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e88b0-74b7-4a4d-9d31-8eb7ef27b698 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:23.200874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:23.201686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:23.202056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:23.202412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:23.203342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:23.203667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:23.205298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aff1a-35a9-480f-835c-602421a5d938 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:23.227115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:26.333116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b27c9-7aba-41e0-99b5-a8a1f06fb65e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:26.333912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b27c9-7aba-41e0-99b5-a8a1f06fb65e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:26.333912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b27c9-7aba-41e0-99b5-a8a1f06fb65e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:26.335070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:26.352563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa0e-fde6-4f42-aa75-9dbe7cb5ef2e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:26.353072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa0e-fde6-4f42-aa75-9dbe7cb5ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:26.353142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2aa0e-fde6-4f42-aa75-9dbe7cb5ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:26.377897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8cb2aa0e-fde6-4f42-aa75-9dbe7cb5ef2e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:26.379136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8cb2aa0e-fde6-4f42-aa75-9dbe7cb5ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:26.480284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:26.509644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a3d6-01bf-4dc3-9bcf-1af1b361f5c7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:26.510265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a3d6-01bf-4dc3-9bcf-1af1b361f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:26.510754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a3d6-01bf-4dc3-9bcf-1af1b361f5c7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:26.512357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:26.520251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:26.520677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:26.520821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:26.536348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622a3d6-01bf-4dc3-9bcf-1af1b361f5c7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:26.542813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:26.544057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:26.646765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:26.732745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:26.822350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:26.962733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622a3d6-01bf-4dc3-9bcf-1af1b361f5c7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:27.081945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f373fb5-7562-44d6-8639-092d06b7ed3b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:27.123190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:27.124535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.125014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.125481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.158975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:27.160203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.160626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.161129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.162664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:27.165380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca99d-df3b-41d3-9eb6-0f51de675796 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:27.170177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-79eb3e2f-e54c-488a-8315-337de5f3c8d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:27.198434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:27.200105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 13/26] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 666 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:27.203307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb6ca-cf98-4b9c-a175-4143a295cbf4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.206002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb6ca-cf98-4b9c-a175-4143a295cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.206002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb6ca-cf98-4b9c-a175-4143a295cbf4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.209633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 14/27] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:27.215345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb6ca-cf98-4b9c-a175-4143a295cbf4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:27.234528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:27.434591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb6ca-cf98-4b9c-a175-4143a295cbf4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:27.530180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:27.532393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.533191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.533969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.535611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:27.536478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:27.539237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77162d2f-cce4-47dd-b0fe-0d6263b9e35f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:27.557950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 15/28] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:27.560855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a43-f273-4fff-a596-d2b8455b805c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.563077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a43-f273-4fff-a596-d2b8455b805c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.563884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a43-f273-4fff-a596-d2b8455b805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.595813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7c7f7a43-f273-4fff-a596-d2b8455b805c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:27.598335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7c7f7a43-f273-4fff-a596-d2b8455b805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:27.677449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 14/29] 10.222.0.60 () {60 vars in 1131 bytes} [Mon Jul 11 13:53:26 2022] POST /identity/v3/roles => generated 219 bytes in 856 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:27.679148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099486de-c681-4007-935e-50f9dc9339c0 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.679449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099486de-c681-4007-935e-50f9dc9339c0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.679734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099486de-c681-4007-935e-50f9dc9339c0 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.681482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:27.682920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd0be-3a4b-4678-beaf-147186622963 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.683226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd0be-3a4b-4678-beaf-147186622963 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.683500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd0be-3a4b-4678-beaf-147186622963 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.685462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 16/31] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:27.685840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fd0be-3a4b-4678-beaf-147186622963 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:27.720474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:27.730450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:27.731712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797930cf-cec8-41c2-ac3e-4bd44def80fe None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.732002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797930cf-cec8-41c2-ac3e-4bd44def80fe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.732283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797930cf-cec8-41c2-ac3e-4bd44def80fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.758754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:27.779147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-797930cf-cec8-41c2-ac3e-4bd44def80fe None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:27.781941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-797930cf-cec8-41c2-ac3e-4bd44def80fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:27.877727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 17/33] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:27.881636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:27.881636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:27.881636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:27.907133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:27.908829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:27.936543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fd0be-3a4b-4678-beaf-147186622963 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.015116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 18/34] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:28.018890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.023167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.024870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.025497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.026129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.029849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.036919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.039778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:27 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:28.042346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.163952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:28.209453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587a4a-8906-43b4-a345-c7be5bd6615b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.212375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:28.249486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7ae2b-0308-431c-ab0c-67ec112a59d9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.259822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.261040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.261537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.262079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.263556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.267514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.294806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.295632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.295916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.296833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.309714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.311257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:53:28.333362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:28.334947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 19/36] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:28.336319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.358056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1131 bytes} [Mon Jul 11 13:53:28 2022] POST /identity/v3/roles => generated 223 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:28.360836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.521944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395de38-2bee-49eb-b441-c1f3b5a6e59c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.539218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6103d4-f3c1-4ec1-99b8-8c4d781356d2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.560672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:28.580250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.581463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.582015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.582520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.584039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.587009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5527b-a545-48a8-8432-341fbac2b3d6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.597227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.598242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.598530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.598807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.600181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.601778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.603544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:28.604362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.659222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1131 bytes} [Mon Jul 11 13:53:28 2022] POST /identity/v3/roles => generated 225 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:28.661017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c00cf9-999e-4e57-8d4a-056f0399971d None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.661518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c00cf9-999e-4e57-8d4a-056f0399971d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.661978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c00cf9-999e-4e57-8d4a-056f0399971d None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.664323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:28.670831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c00cf9-999e-4e57-8d4a-056f0399971d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:28.720758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:28.785127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409aa9-543a-4b97-ac02-3376162ef276 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.841812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.844675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.844675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.844675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.845727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:28.846290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.848190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8686156-d7ad-4dd5-acba-24ad232e9496 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.879158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c00cf9-999e-4e57-8d4a-056f0399971d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:28.880803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 21/41] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:28.885724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.885724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.885724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.909986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:28.911022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:28.947855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:28.949163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:28.949546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:28.950048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] PATH_INFO: `/v3/domains/default/users/2bcd8937417c4772a105e4b213816e7a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:28.952802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2bcd8937417c4772a105e4b213816e7a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:28.954692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:28.956708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:29.003985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:29.004981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:29.036456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1361 bytes} [Mon Jul 11 13:53:28 2022] PUT /identity/v3/domains/default/users/2bcd8937417c4772a105e4b213816e7a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:29.049168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:29.154261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c7dcf-43ee-4b7b-9c45-5ee24957930d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:29.210682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:29.211815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:29.212329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:29.212803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:29.214105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:29.216902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48ebd-949a-47c2-9539-f4c2ef055a2f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:29.226229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:29.259223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f26559-de54-46f8-88a1-84b9ef153150 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:29.322995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:29.323957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:29.324335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:29.324720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:29.326476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:29.328733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:29.330713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:29.339680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:29.474997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4c5f3-69c8-456a-92f5-c141376c5690 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:29.522179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:29.522893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:29.523184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:29.523470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:29.524256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:29.525893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b1bf5-c3f2-4f84-a3a2-fbe294475948 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:29.629354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:53:29 2022] POST /identity/v3/projects => generated 312 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:53:29.740653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:53:29 2022] POST /identity/v3/projects => generated 301 bytes in 730 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:31.409326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b624-792b-4a3e-8592-e7f6792db4b9 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:31.410018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b624-792b-4a3e-8592-e7f6792db4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:31.410319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b624-792b-4a3e-8592-e7f6792db4b9 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:31.412890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:31.422130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:31.422956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:31.423215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:31.443441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:31.445188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:31.461787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:31.539979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:31.581855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b624-792b-4a3e-8592-e7f6792db4b9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:31.587695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:31.726076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b624-792b-4a3e-8592-e7f6792db4b9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:31.768598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:31.769514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:31.769895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:31.770248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:31.786288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:31.795707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:31.797957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:31.799486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:31.800144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:31.809865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:31.970655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296f5dd-3b42-4263-b8f3-a8bced2185f8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.019096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.019841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.020220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.020597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.021498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:32.021943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.023753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994b1f-8b25-46cc-a7ee-5cfad9af83ae None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.034788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:32.040812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:32.118065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:32.131819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c32eb-c097-4c76-a956-ae764c617cf7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.132199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c32eb-c097-4c76-a956-ae764c617cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.132551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c32eb-c097-4c76-a956-ae764c617cf7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.134087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 26/51] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:32.142379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.142825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.143176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.167651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:32.169189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:32.173394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:32.174131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a67a-f7aa-40a5-b743-083d7056b06e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.225032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.226080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.226552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.226908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.228886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.230933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.232807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:32 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:32.239841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:32.268308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 27/53] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:32.292752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:32.378305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75380-39af-4040-88fd-8aaf65a8d53b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.419512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:32.426735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.427660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.428045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.428413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.428588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086dd21-0424-4c40-8c0b-d93cfd635524 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.430394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.432444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.434461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:32.444605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:32.486717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.488106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.488577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.489052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.491421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.494234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.497781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:32.505226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:32.526025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:32.670460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b622-ed2c-4e8b-a3e4-88f64ec7ad57 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.697792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e627-c1e6-4667-8039-fed44eafdd5d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:32.738091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.739282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.739791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.740305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.740481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:32.741209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:32.741609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:32.741780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.742053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:32.743018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.domain.id=default, user.id=2bcd8937417c4772a105e4b213816e7a) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:32.743430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:32.744644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2a1d6-27f6-462c-8dc9-14324662a81c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.745097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce9163-d694-4d54-8244-64a5e2c1e47d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:32.766535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1322 bytes} [Mon Jul 11 13:53:32 2022] GET /identity/v3/role_assignments?user.id=2bcd8937417c4772a105e4b213816e7a&scope.domain.id=default&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 530 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:32.835468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Mon Jul 11 13:53:32 2022] POST /identity/v3/projects => generated 298 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:53:35.096934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964ef1-bce6-467c-98a0-8fe3381cec22 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:35.097498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964ef1-bce6-467c-98a0-8fe3381cec22 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:35.097498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964ef1-bce6-467c-98a0-8fe3381cec22 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:35.098962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:35.108411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:35.109700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:35.109700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:35.138216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:35.141133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:35.231268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:35.245312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:35.272386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6964ef1-bce6-467c-98a0-8fe3381cec22 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:35.353436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:35.419331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6964ef1-bce6-467c-98a0-8fe3381cec22 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:35.481174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:35.482577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:35.483033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:35.484249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:35.486587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:35.489533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b9056-b2a9-4ce8-842e-dfd608c89b10 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:35.492627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:35.498994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:35.612951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9e0b-3b38-4c0c-93f7-8c65f5211532 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:35.652364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:35.653030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:35.653341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:35.653623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:35.654367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:35.655914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ac0fd-bc71-43d4-be2f-96ece616e05d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:35.757997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:53:35 2022] POST /identity/v3/users => generated 275 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:53:39.566070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec032-002f-4fb4-addd-e9a6fa83e920 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:39.566614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec032-002f-4fb4-addd-e9a6fa83e920 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:39.566689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec032-002f-4fb4-addd-e9a6fa83e920 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:39.568375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:39.574245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9be04-7055-41ed-8bbb-6b8312757609 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:39.574777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9be04-7055-41ed-8bbb-6b8312757609 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:39.574851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9be04-7055-41ed-8bbb-6b8312757609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:39.612244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11c9be04-7055-41ed-8bbb-6b8312757609 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:39.614409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11c9be04-7055-41ed-8bbb-6b8312757609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:39.708446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:39.743295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:39.796696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ec032-002f-4fb4-addd-e9a6fa83e920 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:39.894248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d321-0dfa-4ead-8686-30d516c19ef9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:39.894469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d321-0dfa-4ead-8686-30d516c19ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:39.894784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d321-0dfa-4ead-8686-30d516c19ef9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:39.896432 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 33/64] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:39.907999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3735b-519b-461e-8f3e-40971cc5b3a8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:39.908266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3735b-519b-461e-8f3e-40971cc5b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:39.908582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3735b-519b-461e-8f3e-40971cc5b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:39.939843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a7b3735b-519b-461e-8f3e-40971cc5b3a8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:39.941113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a7b3735b-519b-461e-8f3e-40971cc5b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:39.988360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ec032-002f-4fb4-addd-e9a6fa83e920 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.058196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.066911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.067755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.071606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.071606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.089857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:40.091056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:40.101604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98fe48-c5d9-46cb-a7fa-d85cf797401e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.102368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98fe48-c5d9-46cb-a7fa-d85cf797401e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.102847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98fe48-c5d9-46cb-a7fa-d85cf797401e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.104671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:40.113621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:40.114541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:40.115286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:40.116113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 32/67] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:40.123962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98fe48-c5d9-46cb-a7fa-d85cf797401e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.127695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.275736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323fc7c-efef-402e-ac28-8f6ba6aa21d3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.306611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98fe48-c5d9-46cb-a7fa-d85cf797401e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.316712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.316893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.317629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.317944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.318234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.319049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:40.319367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:40.320813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de1df-32ec-4d7f-bc72-6146122158ed None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:40.335035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 33/68] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:40.336404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.336707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.336992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.353929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.354748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.355034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.355310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.357248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:40.359452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:40.369993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:40.379251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:40.380166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:40.380901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 36/69] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:40.381505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.418429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.439337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 34/70] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:40.440306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.528360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54a622-6732-40c5-a777-4b16cf5f6d89 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.568819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e0508-087a-42ff-86d7-a47ddc3d6b5b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.571230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.572376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.572488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.572693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.590122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:40.591693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:40.599958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 37/71] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:40.599958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.615531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.616335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.616629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.616970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.617826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:40.618140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:40.619663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1f992-1176-4150-bf2a-e33acec22ea5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:40.629840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.630496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 35/72] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:40.635313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4408-8c65-4a90-8924-1404e3a7b244 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.635852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4408-8c65-4a90-8924-1404e3a7b244 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.636330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4408-8c65-4a90-8924-1404e3a7b244 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.637960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 36/73] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:40.639218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb4408-8c65-4a90-8924-1404e3a7b244 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.721659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.736722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd86c3-252f-4a0c-ad77-9e4dd6242380 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.774655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.775556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.775850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.776136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.789197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:40.794129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb4408-8c65-4a90-8924-1404e3a7b244 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:40.798559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:40.799708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:40.800532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:40.801151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:40.839196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.839879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.840168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.840453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.910780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:40.928346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b4e4-3079-48ea-a9ca-1689b79c331c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:40.929092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:40.932180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9a11b-0fd6-48b2-ab45-f6bdb90bf5e7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:40.966585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:40.969057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.969480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.969887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.971517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:40.973302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464ba6-360a-481b-9c42-99968e3c4853 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:40.975255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 39/75] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:40.976769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:40.977170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:40.977560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:40.997271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:40.998721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:41.008551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.078969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 37/76] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:41.081269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69394-3d13-436d-8850-d3c0ad027f56 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.081807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69394-3d13-436d-8850-d3c0ad027f56 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.082303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69394-3d13-436d-8850-d3c0ad027f56 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.084847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 38/77] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:41.086562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c69394-3d13-436d-8850-d3c0ad027f56 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.095519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 40/78] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:41.096710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.214030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.238135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c69394-3d13-436d-8850-d3c0ad027f56 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.238971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d270d-073d-4b83-b9f0-bc1cada75dfa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.288268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.289039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.289425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.289805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.290705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:41.291111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.292595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:41.293820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.294781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.295198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.296165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.302775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:41.303656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.318008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.412018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.415083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:41.425571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5238-665e-4618-ad9d-dc71e12ad37c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.464897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.466076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.466541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.466890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.469085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.470675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc1465-6802-449e-b778-2a6aa87f99b4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:41.472569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:41.473906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.474191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.474465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.499622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:41.501798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:41.534201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.571058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 41/81] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:41.571058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.614120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 41/82] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:41.615705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.625709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.730454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6c81c-323e-4f2f-9b89-73347bb0e2c8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.741485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0663-9916-4140-b59a-58ecfef12e9f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.774662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.775486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.775771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.776045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.777360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.779046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:41.781466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:41.781466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.798535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.799459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.799749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.800030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.801371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.802997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:41.806241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:41.806241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:41.855705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.908275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:41.928687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22003-45a7-418c-9b7d-960f7edfee98 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.948388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58c2a-f9b1-450e-82ad-d3ff579358bf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:41.986509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:41.987544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:41.987849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:41.988164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:41.989048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:41.989364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:41.991052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.000602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:42.001528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.002311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.002472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.002726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.003010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.008074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:42.010813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.013898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 43/86] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:41 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:42.015357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.188062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f4cc7-561a-49be-967c-f2ee5208044f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:42.209206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:42.221003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78dfe-a986-41b1-869d-d2ecaefae5d8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:42.245482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.247105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.247623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.248139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.266160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:42.270679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.271407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.271672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.271924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.272661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:42.274241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:42.276806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:42.278965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:42.282477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.366092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:42.372788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 44/88] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:53:42 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:42.373649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.431189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc09a-8dbd-4e39-b77c-28aac01e9c6c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:42.476087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.476841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.477326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.477499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.528511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711622-c639-4c11-90aa-765eb3027c2c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:42.554511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:42.587628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:42.589657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.590406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.591296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.591736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.592163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.594599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=2bcd8937417c4772a105e4b213816e7a) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:42.596359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:42.598147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.606581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/role_assignments?user.id=2bcd8937417c4772a105e4b213816e7a&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:42.607765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.715373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:42.773217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24460-47dc-4e77-83d8-c7e6ae541dad None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:42.828920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:42.829949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:42.830380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:42.830822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:42.831764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:42.832223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:42.833910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:42.845766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 46/90] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:42.857359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:42.861045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 45/91] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:42.867204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:43.012803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7df69e-9a98-43a6-b487-e7d3243f0375 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:43.021184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:43.048230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:43.063541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:43.064465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:43.064946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:43.065240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:43.066649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:43.068515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:43.071334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:43.077392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636511-6b73-4d16-b797-beb6bf2a7e32 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:43.085004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:43.136758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:43.138086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:43.138373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:43.138657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:43.141284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:43.142915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:43.145357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:42 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:43.152475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:43.299075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7417e1-f1fe-4ff2-88a3-0c24fb4064c1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:43.347093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328838b7-b77e-49aa-8a96-d81de8a36c12 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:43.393926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:43.395563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:43.396370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:43.397120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:43.458480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:43.460118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:43.460938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:43.461815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:43.463933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:43.464816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:43.468227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:43.492790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:43 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=51263ee5485341fa98c78d57f2d235fb => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:43.500669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:43.511411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:43.512978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:43.698506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:43.706579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:43.733446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:43.964661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87702e49-cc21-48df-a7f4-cfc76be0c69c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:44.056540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:44.058162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:44.058679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:44.059189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] PATH_INFO: `/v3/projects/fa8764d93a8f4492830ea7ed741ca509` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:44.067211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] RBAC: Authorizing `identity:get_project(project_id=fa8764d93a8f4492830ea7ed741ca509)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:44.070339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7d35-2a0f-4470-b005-cb90f3fd9568 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:44.073845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:43 2022] GET /identity/v3/projects/fa8764d93a8f4492830ea7ed741ca509 => generated 312 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:44.084032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:44.304783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:44.321110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3821-18df-42cd-befe-0c1544c2b7f4 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:44.404476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:44.405762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:44.406297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:44.406812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:44.408539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=fa8764d93a8f4492830ea7ed741ca509, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:44.409120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:44.412104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107fcf0-7939-46a5-9bb0-db29fd2c9dd1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:44.428391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:44 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=fa8764d93a8f4492830ea7ed741ca509&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:45.858463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec1b1-afe7-48cc-a87b-e6da6de6944e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:45.860180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec1b1-afe7-48cc-a87b-e6da6de6944e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:45.860977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec1b1-afe7-48cc-a87b-e6da6de6944e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:45.864449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:45.875546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587d05-121d-451b-9e7e-dea46233548e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:45.877088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587d05-121d-451b-9e7e-dea46233548e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:45.878027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587d05-121d-451b-9e7e-dea46233548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:45.922933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1b587d05-121d-451b-9e7e-dea46233548e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:45.925695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1b587d05-121d-451b-9e7e-dea46233548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:46.064590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 50/99] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:46.132388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fec1b1-afe7-48cc-a87b-e6da6de6944e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:46.317298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:46.366199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af734a4-0dc3-49be-8cb9-46b674f1acf4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.367123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af734a4-0dc3-49be-8cb9-46b674f1acf4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.367875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af734a4-0dc3-49be-8cb9-46b674f1acf4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.374728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 51/100] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:46.380254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae987-3a7f-42db-aa6a-c2801ba402fb None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.381279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fec1b1-afe7-48cc-a87b-e6da6de6944e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:46.381744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae987-3a7f-42db-aa6a-c2801ba402fb None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.382566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae987-3a7f-42db-aa6a-c2801ba402fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.431329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8a1ae987-3a7f-42db-aa6a-c2801ba402fb None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:46.437909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8a1ae987-3a7f-42db-aa6a-c2801ba402fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:46.476473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:46.477766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.478062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.478333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.504487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:46.512640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:46.514951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:46.516438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:46.526033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 50/101] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:46.536377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:46.697525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:46.703239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315464fe-cda0-4478-b5c6-b0e718ecb967 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.703717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315464fe-cda0-4478-b5c6-b0e718ecb967 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.704223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315464fe-cda0-4478-b5c6-b0e718ecb967 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.707002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 53/103] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:46.716045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.716517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.717022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.763919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e897b4-f52a-473b-9320-4fbe6a32cc5b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:46.787733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:46.789913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:46.826091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:46.827311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:46.828334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:46.828830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:46.829324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:46.831257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:46.831798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:46.834421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:46.842963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:46.865453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 51/104] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:46.866983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:46.963729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 54/105] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:46.965120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.148146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046065-3678-4520-8ea1-cb4e532e43a4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.212430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.213253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.213527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.213924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.242479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:47.258287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:47.259977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:47.261469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:47.265810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.296909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a92ed-2b69-4bd5-960b-e5475db1cc0f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.348291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.349208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.349482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.349791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.353321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:47.354882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:47.360511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 55/107] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:46 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:47.362852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.414227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:47.419615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:47.478434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bd5bd-2ec9-41a9-b9bc-6d6d50d25273 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.551900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.553345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.553876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.554374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.558054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:47.562694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:47.567624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 53/108] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:47.570286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.580911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57737c-6f98-4b7c-8b41-5ef150dc1e63 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.631469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.632682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.633149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.633685 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.634967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:47.635476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:47.637984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13ab9e-6fb7-4758-8240-8f56bc4a740a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:47.657618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 56/109] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:47.657618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a9f-0b15-427c-945d-834aabbbf923 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.657618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a9f-0b15-427c-945d-834aabbbf923 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.657618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a9f-0b15-427c-945d-834aabbbf923 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.657618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 57/110] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:47.658666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba4a9f-0b15-427c-945d-834aabbbf923 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.737158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa81c-35f6-4b3e-8c19-61f7acacc637 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.777296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:47.779192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:47.795990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.798149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.798149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.798420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.803042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:47.805387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c537b-368e-4a39-bd98-a00db7ecbacb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:47.813628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 54/111] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:47 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:47.813628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944d81-57fb-4c5d-9c30-5bf4c85090b4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.813628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944d81-57fb-4c5d-9c30-5bf4c85090b4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.813628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944d81-57fb-4c5d-9c30-5bf4c85090b4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.813628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 55/112] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:47.814981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944d81-57fb-4c5d-9c30-5bf4c85090b4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:47.833937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba4a9f-0b15-427c-945d-834aabbbf923 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:47.896116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:47.897138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:47.897481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:47.897896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:47.898986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:47.903319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d5b2a-9394-4ab5-9b42-5626e5df2433 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:47.990758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944d81-57fb-4c5d-9c30-5bf4c85090b4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:48.001998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 58/113] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:53:47 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:48.016055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2f47-4a9a-4549-9512-4e26ef040a1d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.021690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2f47-4a9a-4549-9512-4e26ef040a1d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.021690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2f47-4a9a-4549-9512-4e26ef040a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.054787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-76cc2f47-4a9a-4549-9512-4e26ef040a1d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:48.056701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-76cc2f47-4a9a-4549-9512-4e26ef040a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:48.061938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:48.067412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.067768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.068139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.070780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:48.073283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:48.075841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 56/114] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:47 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:48.077688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:48.188251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 59/115] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:48.188251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.188832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.191219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.194008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:48.227355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:48.230058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:48.263977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a402f1-5f29-486f-8a66-1e1aaa1b63d6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:48.336242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:48.337704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:48.340125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.340874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.341523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/users/7422ae993f7544029fe6660532dc772b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.345744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, user_id=7422ae993f7544029fe6660532dc772b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:48.348793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:48.365611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 60/116] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:48.365611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:48.435235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 57/117] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:53:48 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/users/7422ae993f7544029fe6660532dc772b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:48.439049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:48.520103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c2d3-278b-4d41-b637-8eb1c42f8f12 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:48.564931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:48.565893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.566995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.566995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.568192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:48.570031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:48.577678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 61/118] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:48 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:48.578772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:48.646483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:48.673944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbc97-9bf8-48c0-bc55-e51149b69b54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:48.713437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:48.722175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e8c9-4900-4a41-8919-b596c196e5c2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:48.738225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:48.739712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.740200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.740719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.761525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c230a458-7f78-4dfb-a53e-b6a4cbaa5efe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:48.783544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:48.784434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:48.785177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 58/119] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:53:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:48.787591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ceb2-1faa-418f-948c-28dcbbbb9b3a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.788096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ceb2-1faa-418f-948c-28dcbbbb9b3a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.788607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ceb2-1faa-418f-948c-28dcbbbb9b3a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.791417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 59/120] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:48.793009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ceb2-1faa-418f-948c-28dcbbbb9b3a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:48.794361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:48.796630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.797194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.801766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.824214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-fa2464f5-7d55-4dbd-b06c-8a1e4099d33d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:48.839931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:48.840861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:53:48.841667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:48.843659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 62/121] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:48.845750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:48.848705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:48.848705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:48.876611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:48.878763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:49.008082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ceb2-1faa-418f-948c-28dcbbbb9b3a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:49.013032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 63/122] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:49.015107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:49.088977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:49.091271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:49.091741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:49.093279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/users/2bcd8937417c4772a105e4b213816e7a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:49.097682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, user_id=2bcd8937417c4772a105e4b213816e7a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:49.099674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:49.102054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:49.178236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac681-310e-4a4a-943b-49a672b6d025 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:49.212777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 60/123] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:53:48 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/users/2bcd8937417c4772a105e4b213816e7a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:49.213359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:49.241764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:49.242481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:49.242774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:49.243058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:49.243869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:49.244185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:49.245779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:49.263410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 64/124] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:53:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:49.264988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:49.299028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:49.491809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638677a0-6b79-4c66-b180-51c0fc9afe3e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:49.574776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b558-9004-4dce-bba5-4bbf94f73987 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:49.580977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:49.590963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:49.594821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:49.595339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:49.595836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:49.597394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:49.597995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:49.600762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:49.638284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:49.639878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:49.643708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:49.645068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:49.645541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:49.646097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:49.669319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:49.688102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:49.690285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:49.692257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 65/126] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:49.698554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:49.933980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65675f24-e866-44f5-8d35-7166480debaa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:49.938033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:49.987710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c57c-5006-4692-ab00-f3a98baec8b9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:50.011514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.015305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.016666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.017489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.020233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.023705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.027450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 62/127] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:49 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:50.029442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:50.091998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.093879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.094199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.094492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] PATH_INFO: `/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.114480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=ebcf25fa463d4ab3b04e8ae5271b488d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.116022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.119759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 66/128] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:49 2022] GET /identity/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d => generated 289 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:50.120677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:50.153118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:50.240083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e621d-5cbb-4b71-8a58-70be55c05ca1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:50.290243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c6aa-8ae3-4e05-8b24-672b08cb5459 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:50.304642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.305655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.306111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.306450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.311839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.314707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.318148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 67/129] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:50 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:50.323145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:50.475031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.475810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.476102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.476389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.477178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:50.477490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.478982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.489572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 63/130] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:50.490550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:50.522027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:50.526473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:50.532942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e7f5a-6aec-4807-acf9-277007de7d74 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:50.609028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.610420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.610712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.611004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.614967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f4d2-3ba1-4d84-b80e-2186466c833c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:50.659898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:50.661043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.661409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.661672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/users/7422ae993f7544029fe6660532dc772b/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.664111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, user_id=7422ae993f7544029fe6660532dc772b, role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.665666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.734775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:50.736312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152ca4-2ee1-4909-9813-dc63b330df2f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:50.793944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 64/131] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:53:50 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/users/7422ae993f7544029fe6660532dc772b/roles/51263ee5485341fa98c78d57f2d235fb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:50.794584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:50.921031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:50.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 68/132] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:50.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5141d-8c19-473f-9d3b-7e46dab118c3 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5141d-8c19-473f-9d3b-7e46dab118c3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5141d-8c19-473f-9d3b-7e46dab118c3 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 69/133] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:50.939278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eddf7c-bea3-4998-b753-62c76dcd627a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.939278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eddf7c-bea3-4998-b753-62c76dcd627a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.939278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eddf7c-bea3-4998-b753-62c76dcd627a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.939278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 70/134] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:50.943783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8a1d-9544-4cce-a0a9-fe5cbc238c40 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:50.944263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8a1d-9544-4cce-a0a9-fe5cbc238c40 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:50.944633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8a1d-9544-4cce-a0a9-fe5cbc238c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:50.972326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-371a8a1d-9544-4cce-a0a9-fe5cbc238c40 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:50.974716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-371a8a1d-9544-4cce-a0a9-fe5cbc238c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:51.007610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:51.027787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d82f8-e521-4a7a-8ea1-b3292e91cfa2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.072379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.073206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.073560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.073826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.075326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.077211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.083471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 65/135] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:50 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:51.083471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.090638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 71/136] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:51.094193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.095075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.095557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.113428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:51.114936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:51.202451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 72/137] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:51.203673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.212573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f17f-f46b-4e83-adf6-bc1045bf0391 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.269868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.270667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.271079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.271457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.281941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.281941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.281941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 66/138] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:51.281941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.282277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:51.314045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:51.334209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d912-0329-433d-b580-5448ea051bb5 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.375361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349c42-727f-4263-932a-c977235f02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.376553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349c42-727f-4263-932a-c977235f02cb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.377009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349c42-727f-4263-932a-c977235f02cb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.377453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349c42-727f-4263-932a-c977235f02cb None admin] PATH_INFO: `/v3/projects/fa8764d93a8f4492830ea7ed741ca509` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.378941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349c42-727f-4263-932a-c977235f02cb None admin] RBAC: Authorizing `identity:get_project(project_id=fa8764d93a8f4492830ea7ed741ca509)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.380577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349c42-727f-4263-932a-c977235f02cb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.382530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 73/139] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/projects/fa8764d93a8f4492830ea7ed741ca509 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:51.383556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349c42-727f-4263-932a-c977235f02cb None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.406326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611bde-3b8c-46b0-bfcd-fdc070d55e88 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.447668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.448661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.448961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.449244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.450615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.452759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.454894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 67/140] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:51.455757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.509089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349c42-727f-4263-932a-c977235f02cb None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.537231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:51.551921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.553080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.553542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.554017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.567113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:51.571628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:51.577212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:51.578833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:51.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:51.582360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d384-f8e5-41cd-993e-dac1a699854f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.582495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 74/141] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:51.582495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.633337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.634439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.634927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.635401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.637098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=ebcf25fa463d4ab3b04e8ae5271b488d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:51.637714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.641318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.653146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 68/142] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/role_assignments?user.id=ebcf25fa463d4ab3b04e8ae5271b488d&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:51.663106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.707457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d7cc-4918-4000-88b2-d66e996e3821 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.765813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:51.766743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:51.767025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:51.767308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] PATH_INFO: `/v3/projects/fa8764d93a8f4492830ea7ed741ca509/users/7422ae993f7544029fe6660532dc772b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:51.769480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa8764d93a8f4492830ea7ed741ca509, user_id=7422ae993f7544029fe6660532dc772b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:51.771223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:51.881513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 75/143] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:53:51 2022] PUT /identity/v3/projects/fa8764d93a8f4492830ea7ed741ca509/users/7422ae993f7544029fe6660532dc772b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:51.892992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:51.917208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed31d9-b0d9-4304-93b5-40e5b1660b31 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:51.998904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:52.013280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:52.015380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.016305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.016806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.020532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:52.024395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:52.153025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382092-0a82-4825-82f2-7f7945c4a1b7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:52.175190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 69/144] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:53:51 2022] POST /identity/v3/users => generated 283 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:52.213456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:52.214198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.214543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.214831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.215617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:52.215934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:52.219387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:52.235384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 76/145] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:52.242312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:52.265603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:52.398266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e785ef3-e565-47d7-a22c-01f92401d297 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:52.480379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:52.481783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.482259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.483293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.485843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:52.488621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff2607-6ce4-4ff7-89db-d3ab1157bae0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:52.492323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 70/146] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:52 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:52.499415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:52.752487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb7a9-8539-4fd3-a7e4-96930aace2fd None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:52.757179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:52.819471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:52.820584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.821079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.821600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.827268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6b67-ecd6-4112-a397-08fa864e3dc6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.827699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6b67-ecd6-4112-a397-08fa864e3dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.828174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6b67-ecd6-4112-a397-08fa864e3dc6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.830660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 71/147] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:52.839996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af393e-668f-465f-a462-0940cc456635 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:52.840456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af393e-668f-465f-a462-0940cc456635 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:52.840923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af393e-668f-465f-a462-0940cc456635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:52.891590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-98af393e-668f-465f-a462-0940cc456635 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:52.893548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-98af393e-668f-465f-a462-0940cc456635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:52.978601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:52.981871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:53.140436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 72/148] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:53.195562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af393e-668f-465f-a462-0940cc456635 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:53.215823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 77/149] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:53.223877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:53.228330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:53.243619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:53.580711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107967-8a7c-4144-87ea-fcb4304e9e16 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:53.605065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af393e-668f-465f-a462-0940cc456635 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:53.686852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:53.689430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:53.690699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:53.691267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:53.691913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:53.693560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:53.695658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:53.697253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:53.698057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:53.702031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:53.708468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 78/150] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:53 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:53.719034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:53.738408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:53.747709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:53.749872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:53.751572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 73/151] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:53.755292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:53.945918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:53.954202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:54.006809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be985ba-7dac-46d1-9573-d3f3cf67fe7a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:54.010283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc568-593e-467c-9297-cc15c88afd77 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:54.107580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:54.108323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.108584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.108982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.109904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:54.110223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:54.110456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:54.111158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.111451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.111729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.111884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:54.112517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:54.112828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:54.114604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:54.118838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 79/152] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:53 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:54.133557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 74/153] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:54.139754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:54.304491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec20e6-b092-44da-8842-55391fbaa240 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:54.359804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:54.360760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.361112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.361360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] PATH_INFO: `/v3/users/2bcd8937417c4772a105e4b213816e7a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.362870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcd8937417c4772a105e4b213816e7a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:54.364398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ee100-8a76-4053-98ed-8c2efa510b31 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:54.366762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 80/154] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:54 2022] GET /identity/v3/users/2bcd8937417c4772a105e4b213816e7a => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:54.372442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:54.521177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270ace-d8e0-481c-8103-5bd19dfd7e81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:54.575515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:54.577541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.577541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.577541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.598075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:54.599762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56227b-9ccb-4c5f-ad32-249a5fb7ab73 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.600052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56227b-9ccb-4c5f-ad32-249a5fb7ab73 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.600905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56227b-9ccb-4c5f-ad32-249a5fb7ab73 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.602205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 81/155] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:54.615159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:54.615471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:54.615727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:54.630095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:54.653829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:54.655902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:54.725560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:54.727134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:54.851126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 82/156] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:54.895790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 75/157] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:53:54.905110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:54.949678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:55.024841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:55.103751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7151-7c0c-4fd9-8c27-48debef33ca6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:55.151165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:55.152007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:55.152443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:55.152680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:55.167955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:55.171908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05af90-3b73-43db-9c4f-352eb5012637 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:55.176623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:55.178743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:55.180392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 76/158] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:53:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:53:55.192864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:55.345339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:55.346372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:55.346793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:55.346793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:55.354634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:55.356088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:55.359188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 83/159] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:54 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:55.378694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:55.382965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a0ec-1d17-4915-88ae-78369969db82 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:55.385934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:55.390144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:55.433735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:55.434509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:55.434798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:55.435081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:55.436897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:55.437212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:55.438834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:55.449516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 77/160] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:53:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:55.458990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:55.673974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc0da-0187-4cd3-975f-45b01c3febd7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:55.680078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ab346-b284-4302-8681-6f634e724216 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:55.784278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:55.785864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:55.786433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:55.786942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:55.791780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:55.794778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:55.796444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:55.796951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:55.801085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:55.801085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=2bcd8937417c4772a105e4b213816e7a) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:55.801085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:55.803699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:55.810164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 78/161] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:55 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:53:55.810388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6658-330a-4bbe-905e-142ade8cb59f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:55.820682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:55.842392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 84/162] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:55 2022] GET /identity/v3/role_assignments?user.id=2bcd8937417c4772a105e4b213816e7a&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:55.918119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:56.079945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e53c-89f1-4407-92ef-1cba9b072329 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:56.171307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:56.172690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.173185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.173703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.327916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:56.330890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:56.398337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:56.444999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065a40-deff-44b5-b139-6a024c4ed0c4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.445521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065a40-deff-44b5-b139-6a024c4ed0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.445891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065a40-deff-44b5-b139-6a024c4ed0c4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.448767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 85/163] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:53:56.458292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea87e-4c30-48f9-91ae-0c1467bd7d9f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.458771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea87e-4c30-48f9-91ae-0c1467bd7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.459246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea87e-4c30-48f9-91ae-0c1467bd7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.502738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-329ea87e-4c30-48f9-91ae-0c1467bd7d9f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:56.504331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-329ea87e-4c30-48f9-91ae-0c1467bd7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:56.577775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 79/164] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:53:56.587442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:56.686316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:56.695680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 86/165] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:53:56.698684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4963a0-cd7d-49c2-8ce7-8f0e105c4925 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.699314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4963a0-cd7d-49c2-8ce7-8f0e105c4925 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.700092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4963a0-cd7d-49c2-8ce7-8f0e105c4925 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.702352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 87/166] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:56.707316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016f3a-284b-4e98-b6ad-8bcf571f06b4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.707914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016f3a-284b-4e98-b6ad-8bcf571f06b4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.708392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016f3a-284b-4e98-b6ad-8bcf571f06b4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.710499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 88/167] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:56.712206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2bf96-8c7e-4d8e-8698-518142bb17ce None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.712756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2bf96-8c7e-4d8e-8698-518142bb17ce None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.713235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2bf96-8c7e-4d8e-8698-518142bb17ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.734608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-00a2bf96-8c7e-4d8e-8698-518142bb17ce None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:56.736614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-00a2bf96-8c7e-4d8e-8698-518142bb17ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:56.806072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f7e1b-d842-4c2b-ad8c-895f2a813957 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:56.840237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 89/168] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:56.842715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004479-9662-40ff-981a-29613d7c630d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.843276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004479-9662-40ff-981a-29613d7c630d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.843784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004479-9662-40ff-981a-29613d7c630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5c004479-9662-40ff-981a-29613d7c630d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:56.865941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:56.867330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5c004479-9662-40ff-981a-29613d7c630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:56.896579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:56.898339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:56.898797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:56.899281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:56.902221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:56.905036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:56.913513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 80/169] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:56 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:56.913513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:56.981803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 90/170] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:56.983775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004479-9662-40ff-981a-29613d7c630d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.069606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:57.104703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8950a3-0019-4b3d-99c8-8278d60ca474 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.158145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004479-9662-40ff-981a-29613d7c630d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.162499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.163474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.163872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.164338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.186249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:57.205939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:57.207126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:53:57.207900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:53:57.208519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 81/171] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:57.209614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.211854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.213010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.213524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.214038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.229684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:57.240317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:57.241303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:53:57.242113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:57.245902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 91/172] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:57.247367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.366322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:57.397093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8078d-5829-4034-b49f-8b70e1d18977 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.419883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:57.428040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0f19-ff2a-4934-b4fa-3fe8a04cf43c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.447161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.448791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.449284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.450781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.466958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:57.476321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:57.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:57.478476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 92/173] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:57.479160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.503537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.504736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.505241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.505771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.507467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:57.508038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:57.510834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:57.529811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 82/174] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=51263ee5485341fa98c78d57f2d235fb => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:57.529811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.674044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a328a81-e4d9-4b6e-ba54-a5b91d33f275 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.684708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5f8f-8cea-4e6d-b8b1-bc92a4cb6084 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:57.710000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:57.721351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.722254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.722622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.722903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.723684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:57.724000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:57.725558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7baaf-60f2-48f8-8836-503368005719 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:57.740534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 83/175] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:57.742731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ad9f7-347a-4b26-af12-c336d669cdd9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.742731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ad9f7-347a-4b26-af12-c336d669cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.742731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ad9f7-347a-4b26-af12-c336d669cdd9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.744124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 84/176] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:57.750654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ad9f7-347a-4b26-af12-c336d669cdd9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.770721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:57.772011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.772262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.773465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.774243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:57.774795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:57.777525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c027b0-1e1d-424f-9350-2e91ca4994d0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:57.794186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 93/177] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:57.795403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:57.795696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:57.795979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:57.824843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:57.826684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:57.873665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:57.919439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 94/178] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:57.926257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:57.962070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ad9f7-347a-4b26-af12-c336d669cdd9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.002623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.003320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.003597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.003875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.004650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:58.004956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.006424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.017104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 85/179] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.018591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.049561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd17b-f27e-4df5-9c9c-dfe971175d6b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.068303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.091581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.092749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.093038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.093314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] PATH_INFO: `/v3/users/7422ae993f7544029fe6660532dc772b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.094668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] RBAC: Authorizing `identity:get_user(user_id=7422ae993f7544029fe6660532dc772b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.096166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcc64-558f-43b1-8d28-fe8ac032cf46 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.097964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 95/180] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:57 2022] GET /identity/v3/users/7422ae993f7544029fe6660532dc772b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.099247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5ec0-f198-4326-9f30-9b1fdce7e06c None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.099530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5ec0-f198-4326-9f30-9b1fdce7e06c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.099808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5ec0-f198-4326-9f30-9b1fdce7e06c None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.101930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 96/181] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:53:58.102691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5ec0-f198-4326-9f30-9b1fdce7e06c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.150194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5a042-9c42-4485-ae2e-ae027945dee9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.153545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.198599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.199409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.199694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.199970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] PATH_INFO: `/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.201324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] RBAC: Authorizing `identity:get_user(user_id=ebcf25fa463d4ab3b04e8ae5271b488d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.203093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.204813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 86/182] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.209786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.246243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5ec0-f198-4326-9f30-9b1fdce7e06c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.308266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.309726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.310218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.311302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.331110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30e74-fde7-4323-b286-331ebad7231a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.331363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:53:58.344622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:53:58.348068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:53:58.354721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 97/183] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:53:58.356102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.379309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.380241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.380518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.380796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.398618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.401137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a02d8-a77e-4945-af41-fb8cc08d40ae None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.410096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 87/184] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.410096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.410096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.410096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.436180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:53:58.438153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:53:58.513431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.522956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b259e-001b-41f7-939f-ba04af39e4c3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.549848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 88/185] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:53:58.550967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.592594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.593348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.593786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.594282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.693851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.695753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.712119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.715988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49a14-8223-45a0-adc3-3cedf035eecf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.766804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.767626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.767972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.768313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.769891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.771807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.774335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 89/186] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.775219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.823124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:58.830436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 98/187] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:58.831291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:58.920498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270cf3-f84e-47e3-a93c-6beb76cd3913 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.956824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c426c-bb90-4bf7-aa8e-0797b50f8983 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:58.971754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:58.972461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:58.972732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:58.973010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:58.973814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:53:58.974122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:58.975566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:58.986330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 90/188] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:58.987034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.015215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.016277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.016753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.017131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.039602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:59.124162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:59.135354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.137830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.157791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faea15-2a89-4249-9618-f768717c35cd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.203891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.204795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.205021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.205256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.206601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.208104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.209874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 91/189] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:59.210665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.302504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 99/190] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:53:59.302504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.364325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:59.374657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1d3c8-c844-4f23-bd51-415109dc85d9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.427107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.428020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.428302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.428584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/users/ebcf25fa463d4ab3b04e8ae5271b488d/roles/37be87e2fc4744a0ae6b50111e736800` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.430776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, user_id=ebcf25fa463d4ab3b04e8ae5271b488d, role_id=37be87e2fc4744a0ae6b50111e736800)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.432290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.436196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:59.443176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647da3-5ddd-4914-af15-db6139ebdace None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.507982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.509654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.510175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.510690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] PATH_INFO: `/v3/projects/fa8764d93a8f4492830ea7ed741ca509` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.513074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] RBAC: Authorizing `identity:get_project(project_id=fa8764d93a8f4492830ea7ed741ca509)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.517200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.520470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 100/191] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:59 2022] GET /identity/v3/projects/fa8764d93a8f4492830ea7ed741ca509 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:59.521945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.536523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 92/192] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:53:59 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/users/ebcf25fa463d4ab3b04e8ae5271b488d/roles/37be87e2fc4744a0ae6b50111e736800 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:53:59.538373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.686686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d16b-5e27-4f0e-b3f8-a025d85ba018 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.736341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7f16-fd2c-4531-bfd5-a6179e27b5ff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.749063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.749984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.750276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.750554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.751864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.753368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.755342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 101/193] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:53:59 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:59.761243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.799687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.800386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.800828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.803284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.804220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.805888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.808897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:53:59.891054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47ac5-ede1-4721-a7da-666092435c7a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:53:59.930121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 93/194] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:53:59 2022] POST /identity/v3/users => generated 297 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:53:59.931288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.950581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:53:59.950581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:53:59.950581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:53:59.950581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:53:59.951607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:53:59.951607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:53:59.951607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 102/195] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:53:59 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:53:59.952003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:53:59.974236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:00.129604 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:00.134839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7d72-a106-44d6-90fb-322b4713de14 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:00.188546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c09bf-3c96-430e-bb9e-ff7af0aeacd4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:00.192071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:00.194237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:00.194637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:00.195164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:00.280305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:00.280305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:00.280305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:00.280305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:00.280914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=fa8764d93a8f4492830ea7ed741ca509, user.id=7422ae993f7544029fe6660532dc772b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:00.280914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:00.283278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:00.301794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 94/196] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:53:59 2022] GET /identity/v3/role_assignments?user.id=7422ae993f7544029fe6660532dc772b&scope.project.id=fa8764d93a8f4492830ea7ed741ca509&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:00.301794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:00.310097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:00.311880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:00.486722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:00.499304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 103/197] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:00.506267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:00.508133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:00.567792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3ca5-5ba5-43dc-8672-a0572cd64bce None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:00.653673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:00.654984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:00.655279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:00.655791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:00.656643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=9c693e681635488e8016f1c46825d165) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:00.656963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:00.658798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:00.665532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 95/198] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:00 2022] GET /identity/v3/role_assignments?user.id=9c693e681635488e8016f1c46825d165&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:00.731891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc0eb-d124-4c58-911a-f2e59d61fbb2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:00.785298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:00.786407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:00.786699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:00.786977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:00.790214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:00.791892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96d087-8d3b-42b1-9370-38e103b277a2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:00.793928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 104/199] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:00 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:00.801457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:00.956403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb34ec-1496-411b-849f-0790e04af30f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:01.012098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:01.013084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:01.014091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:01.014526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:01.015569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=9c693e681635488e8016f1c46825d165) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:01.016035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:01.017768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541a996-6669-45db-a589-2bc23f69c43a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:01.031327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 96/200] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:00 2022] GET /identity/v3/role_assignments?user.id=9c693e681635488e8016f1c46825d165&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=51263ee5485341fa98c78d57f2d235fb => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:02.789125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6f36-c8e1-4c9f-aabb-d10521911c86 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:02.790055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6f36-c8e1-4c9f-aabb-d10521911c86 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:02.790055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6f36-c8e1-4c9f-aabb-d10521911c86 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:02.791447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 105/201] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:02.799774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:02.799774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:02.799774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:02.805352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:02.819069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:02.820568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:02.927904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 97/202] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:02.958754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6f36-c8e1-4c9f-aabb-d10521911c86 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:03.128881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:03.183354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6f36-c8e1-4c9f-aabb-d10521911c86 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:03.234723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:03.235882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.236336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.236774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.257345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:03.266457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:03.267754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:03.268769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:03.271123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 106/203] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:03.279500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:03.439330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d132e7-7125-4a0b-b720-8916b74a89c2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:03.484992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:03.486249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.486715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.487177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.488166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:03.488638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:03.490462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:03.492401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:03.508109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 98/204] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:03.514794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:03.681455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8120a-0261-4bc6-b02b-a4c0e0a4bfd3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:03.725893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:03.737490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:03.738498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.738784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.739151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] PATH_INFO: `/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.740630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] RBAC: Authorizing `identity:get_user(user_id=ebcf25fa463d4ab3b04e8ae5271b488d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:03.742305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b33dc-a9e0-4a35-8626-d522215eeb44 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:03.745672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 107/205] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:03 2022] GET /identity/v3/users/ebcf25fa463d4ab3b04e8ae5271b488d => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:03.751274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:03.758838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d436-a63c-486d-b09d-22f033143894 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.759174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d436-a63c-486d-b09d-22f033143894 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.759409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d436-a63c-486d-b09d-22f033143894 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.761054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 108/206] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:03.779582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8465b69-aa47-462a-9878-4a3bda12886b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.779858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8465b69-aa47-462a-9878-4a3bda12886b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.780179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8465b69-aa47-462a-9878-4a3bda12886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.824994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d8465b69-aa47-462a-9878-4a3bda12886b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:03.826432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d8465b69-aa47-462a-9878-4a3bda12886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:03.958782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 109/207] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:03.965609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298dda-0841-4354-a87e-a53eed67e7fc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.967018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298dda-0841-4354-a87e-a53eed67e7fc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.967534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298dda-0841-4354-a87e-a53eed67e7fc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:03.970302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 110/208] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:03.985748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:03.986696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:03.987466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.002321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6bb23-e4e8-44a3-ae73-70ad1d3992b2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.020466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:04.023245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:04.045801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.046660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.047032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.047387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.136132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 111/209] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:04.137014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.161734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.165346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:04.169006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1f9df-d1c6-4204-acd1-4a85b3a8702d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:04.214199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.276266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5af30-ac5e-4ccf-b70a-e0f6dd8b3e14 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.320038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.321385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.321914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.322412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.343039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:04.345933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 99/210] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:04.347436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31acee0-0d2c-4c98-af7c-e9152e36302f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.347732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31acee0-0d2c-4c98-af7c-e9152e36302f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.348010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31acee0-0d2c-4c98-af7c-e9152e36302f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.349682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 100/211] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:04.350363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31acee0-0d2c-4c98-af7c-e9152e36302f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:04.367016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:04.368009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:04.368773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:04.369363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 112/212] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:04.371099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.503374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdd16d-bdb5-44c1-b45c-2d61add98b71 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.513153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.524203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31acee0-0d2c-4c98-af7c-e9152e36302f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.531376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.553569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.557969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.557969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.557969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.557969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:04.558287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d10b5-474a-44d9-a985-5bdfeab69260 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:04.565797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 113/213] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:04.565797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.565797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.565797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.580277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.581113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.581397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.581702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.584497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:04.585901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:04.598402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:04.606559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:04.608221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:04.608998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:04.618847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 101/214] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:04.618847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.725840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 114/215] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:04.727665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.753824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00137bac-9be5-4bb1-8a5d-964bf3653bb9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.812575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.813806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.814319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.814873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.816826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:04.816963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:04.819671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:04.840330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 102/216] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:04.840330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.866305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.885999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04233-42f5-46e3-bc0c-9c33ce297b3e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:04.908136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:04.932701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:04.935192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:04.935192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:04.935192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:04.935192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, scope.project.id=2952813ddae54de5b5ddb512178a815c, user.id=ebcf25fa463d4ab3b04e8ae5271b488d) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:04.935544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:04.937391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:04.945090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 115/217] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/role_assignments?user.id=ebcf25fa463d4ab3b04e8ae5271b488d&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:04.946554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:04.980039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce121-052c-4709-b4a4-a3b61e6c7da7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.038399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.040262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.040767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.041570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.043228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:05.044054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.047674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.062453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 103/218] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:05.063580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.112374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a9757-3310-47c7-b20b-93cc25a0b26b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.165913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.166832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.167115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.167386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.168789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.171344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.173218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 116/219] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:05.174086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.182089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:05.218649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9a387-f2a4-4c86-a44e-1c004d283d6f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.252753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:05.289797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.291188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.291586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.292055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.294264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.297155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336497-a3db-4cdb-91dc-a63ea9d0189a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.300416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 104/220] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:05 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:05.302653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1d2f0-e61f-4987-a00a-182a438a6f4f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.303106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1d2f0-e61f-4987-a00a-182a438a6f4f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.303526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1d2f0-e61f-4987-a00a-182a438a6f4f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.305376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 105/221] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:05.306307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1d2f0-e61f-4987-a00a-182a438a6f4f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.348101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c174-fe0a-4e15-9e83-632821e7050b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.406817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.407720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.408100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.408384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] PATH_INFO: `/v3/users/665c4a21440b4d8a881c648df11bff38` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.427855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] RBAC: Authorizing `identity:get_user(user_id=665c4a21440b4d8a881c648df11bff38)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.429362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.431341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 117/222] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:05 2022] GET /identity/v3/users/665c4a21440b4d8a881c648df11bff38 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:05.431341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.455975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1d2f0-e61f-4987-a00a-182a438a6f4f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.508313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.509009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.509297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.509598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.510350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.511859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655cb13-ad4b-419d-8751-1502877d8bfa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.577063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67ec4-6712-415f-91c6-3c96230df04a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.581138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:05.627292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 106/223] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:05 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:05.629332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.630267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.630561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.638238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.639850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.640554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.641431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.643114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:05.644799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:05.647176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 118/224] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:05 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:05.648326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.651878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:05.668566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:05.670901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:05.788478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 107/225] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:05.788478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:05.835363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca857b-674e-45d5-8a76-f9bd73813cc5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:05.898219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:05.899101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:05.899101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:05.899799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:05.974329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:05.987669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5ad6b-d2c1-4f11-8f49-7321ef23a0e8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:06.039116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:06.042166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:06.075164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:06.078058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:06.078547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:06.079045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/9c693e681635488e8016f1c46825d165/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:06.082908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, user_id=9c693e681635488e8016f1c46825d165, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:06.087098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:06.092857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:06.189446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 108/226] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:54:05 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/9c693e681635488e8016f1c46825d165/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:06.190718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:06.303312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 119/227] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:06.313033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:06.441769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7559fbe-0f19-43a4-97e5-5de97c3aae2d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:06.552579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:06.569287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:06.570796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:06.571290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:06.571730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:06.601964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:06.614844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:06.615798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:06.617044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 109/228] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:06.626695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:06.627541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a3c34-d099-4be1-a856-4217374a124e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:06.679320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:06.680682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:06.682222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:06.683464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:06.685863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:06.689298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:06.693809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 120/229] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:06 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:06.698474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:06.749191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:06.796685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254275-c139-4e46-a5da-eebea8c2897b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:06.842760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:06.843581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:06.843869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:06.844318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:06.845242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:06.845554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:06.847967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:06.885317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 110/230] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:06.895931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:06.986230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148b0d-f8c7-4adb-8770-6d2aaac6a47a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:07.050785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:07.051745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:07.052526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:07.053173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:07.054557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=665c4a21440b4d8a881c648df11bff38) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:07.057604 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:07.059672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:07.068986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 121/231] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:06 2022] GET /identity/v3/role_assignments?user.id=665c4a21440b4d8a881c648df11bff38&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:07.151163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e669e4-91c4-4876-920d-8536db515c4e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:07.182103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:07.207552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:07.208860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:07.209304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:07.209760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:07.211381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:07.218272 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:07.221163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 111/232] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:06 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:07.227839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:07.239677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:07.433195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe9ad-a2e3-475a-bc70-60a46a7e2e38 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:07.481021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:07.482001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:07.482291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:07.482571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:07.486588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:07.488113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604477-d869-4083-afd3-ad7d75d61730 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:07.490486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 122/233] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:07 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:07.496586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:07.657299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ee30-3dc3-4643-8115-4321e370b9b7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:07.701356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:07.702322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:07.702610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:07.702889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/9c693e681635488e8016f1c46825d165/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:07.711886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, user_id=9c693e681635488e8016f1c46825d165, role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:07.713420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324696-cccb-4710-a74c-e4bba94a13c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:07.819684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 112/234] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:54:07 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/9c693e681635488e8016f1c46825d165/roles/51263ee5485341fa98c78d57f2d235fb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:08.712723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b26-3cc4-484c-ae8e-7709e6610780 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:08.713247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b26-3cc4-484c-ae8e-7709e6610780 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:08.713247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b26-3cc4-484c-ae8e-7709e6610780 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:08.714690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 123/235] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:08.721139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b1af-605f-4002-bcb5-dd8c8f0abeda None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:08.722121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b1af-605f-4002-bcb5-dd8c8f0abeda None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:08.722655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74b1af-605f-4002-bcb5-dd8c8f0abeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:08.744242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fa74b1af-605f-4002-bcb5-dd8c8f0abeda None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:08.746096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fa74b1af-605f-4002-bcb5-dd8c8f0abeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:08.806304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:08.846649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 113/236] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:08.895467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684b26-3cc4-484c-ae8e-7709e6610780 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.002627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:09.005028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f405-52ff-446b-a397-28d31e3ead47 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.005307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f405-52ff-446b-a397-28d31e3ead47 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.005795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f405-52ff-446b-a397-28d31e3ead47 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.007419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 114/237] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:09.014356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.020499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.020499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.049154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684b26-3cc4-484c-ae8e-7709e6610780 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.058514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:09.059803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:09.101215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.102098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.102382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.102652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.135290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:09.144131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:09.145393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:09.146544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:09.154841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 124/238] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:09.161176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.175640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 115/239] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:09.227159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.394404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75381b-5dff-408b-b4cd-27ef334f5dcd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.397283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:09.429151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255c-a653-44de-9051-6e2e7f8c89a3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.442783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82866c6-828b-479f-805f-febc64223414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.443600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82866c6-828b-479f-805f-febc64223414 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.443883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82866c6-828b-479f-805f-febc64223414 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.444163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82866c6-828b-479f-805f-febc64223414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.457993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82866c6-828b-479f-805f-febc64223414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e82866c6-828b-479f-805f-febc64223414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:09.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:09.471023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:09.474252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 116/240] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:09.483671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82866c6-828b-479f-805f-febc64223414 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.513251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:09.524205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.524910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.526029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.526029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.529916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:09.530340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:09.533498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:09.562116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 125/241] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:09.567148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.712634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82866c6-828b-479f-805f-febc64223414 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.759637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.760778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.761041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.761266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.765618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:09.765618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:09.765618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:09.775147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 117/242] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:09.781570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:09.822554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:09.873992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592e0a6-3a26-4456-b1c9-8ae270a595ac None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.929094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf05-45a1-45f6-87a8-d7a1cbde30b0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:09.973553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.975634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.976157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:09.976758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.977053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.977340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.977634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.978562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] PATH_INFO: `/v3/users/c89684186135491099444d56cf97a3a3` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.979080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:09.980638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920855-e569-4d1f-8fd3-f954e05f538d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:09.983380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 118/243] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:09.984574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf89e-8cbc-4c38-a19d-da5c238957dc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:09.984744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf89e-8cbc-4c38-a19d-da5c238957dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:09.985013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf89e-8cbc-4c38-a19d-da5c238957dc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:09.990947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 119/244] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:09.991811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf89e-8cbc-4c38-a19d-da5c238957dc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:10.008021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] RBAC: Authorizing `identity:get_user(user_id=c89684186135491099444d56cf97a3a3)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:10.009536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa718f4-6cab-4aae-9b5a-6aa030eed9ab None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:10.011737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 126/245] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/users/c89684186135491099444d56cf97a3a3 => generated 297 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:10.013349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.013538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.013841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.033619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:10.035006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:10.105552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.136094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 127/246] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:10.139973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:10.196459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.208781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf89e-8cbc-4c38-a19d-da5c238957dc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:10.280534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:10.281681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.282175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.282736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.321559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6377de-2fe1-4964-a5b4-f6153893ba80 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:10.383694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:10.384674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.385132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.385606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.390478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:10.392412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:10.473293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.507623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:10.509907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4ae21-1e7b-406a-9d4f-260d864070c8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:10.543686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.556736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:10.558713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:10.667558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 128/248] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:10.669389 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62d68-ff2f-404e-a6df-8a1c81cc3ed2 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.669730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62d68-ff2f-404e-a6df-8a1c81cc3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.670068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62d68-ff2f-404e-a6df-8a1c81cc3ed2 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.671985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 129/249] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:10.673422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62d68-ff2f-404e-a6df-8a1c81cc3ed2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:10.742362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643a964-34d5-45d7-bbd9-ed1f59bdc2b3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:10.813004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:10.814175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.814585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.814996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.816533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:10.818364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:10.820323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 121/250] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:10.822554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:10.837510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.869538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62d68-ff2f-404e-a6df-8a1c81cc3ed2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:10.929956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:10.944111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:10.945568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.947088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.947088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.948525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:10.950896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe3f7-2d38-41b5-ac23-18f1401be68b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:10.961989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 130/251] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:10 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:10.961989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:10.961989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:10.961989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:10.987280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:10.989196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:11.007258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ba8bc-f9fc-4113-8211-3dc03dd8902e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:11.070624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:11.071924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.072331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.072733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.075009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:11.078175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:11.088196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 122/252] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:10 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:11.088196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.104925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 131/253] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:11.115419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.206161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:11.226915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346830-d62e-47e2-9937-c97bdc38abe4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:11.231640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec74c-035c-46db-a420-5e80e5e89d77 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:11.270801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:11.277300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:11.278024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.278315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.279600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.280643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=9c693e681635488e8016f1c46825d165) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:11.280961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:11.282384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:11.283189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8fda-f304-478f-a09d-1b720750a3f4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:11.283288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.283693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.284098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.285241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:11.288246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 132/254] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:11 2022] GET /identity/v3/role_assignments?user.id=9c693e681635488e8016f1c46825d165&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce5c6-1040-4c36-8d06-0d265a855692 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce5c6-1040-4c36-8d06-0d265a855692 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce5c6-1040-4c36-8d06-0d265a855692 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 133/255] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:11.299965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badce5c6-1040-4c36-8d06-0d265a855692 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.393889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 123/256] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:11 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:11.406965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.515139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badce5c6-1040-4c36-8d06-0d265a855692 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:11.582919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:11.584003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.584510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.585075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.586808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=c89684186135491099444d56cf97a3a3) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:11.587375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:11.591969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11bd2e-2448-4b77-9c22-ec9399f79c1e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:11.603151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 134/257] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:11 2022] GET /identity/v3/role_assignments?user.id=c89684186135491099444d56cf97a3a3&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:11.606171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.607701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.609673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.633659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa24-6605-48c8-bf1f-ae62563443d4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:11.659020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:11.661308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:11.663018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:11.692028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:11.692878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:11.693162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:11.693449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:11.715264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:11.724679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:11.726495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:11.728085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 124/258] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:11.736882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.769054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 135/259] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:11.793831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:11.839351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:11.960124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483001-4ce4-4d70-a1d5-bfbec59491cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.010084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f50176-d56d-4ccc-b4f9-c8859f166907 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.023369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.024470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.024952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.025424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.026786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:12.027314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.030512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:12.046324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 125/260] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:12.058729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.111402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.112060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.112343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.112621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.135348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:12.143550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:12.162812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:12.163777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:12.164614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 136/261] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:12.173512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.204786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa86b-93bf-4b30-9037-7b6f915caf45 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.223812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:12.273167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.275320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.276139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.276891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] PATH_INFO: `/v3/users/665c4a21440b4d8a881c648df11bff38` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.280477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=665c4a21440b4d8a881c648df11bff38)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.283508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:12.286578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 126/262] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:12 2022] GET /identity/v3/users/665c4a21440b4d8a881c648df11bff38 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:12.293323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.447471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52991d2-f44a-4d2d-b5ad-0d55b9ab83ec None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.492910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b54e1-3266-4f78-9a94-0f61e02ac8a4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.515522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.516231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.516521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.516806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.517620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:12.517939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.519434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:12.530514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 137/263] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:12.536085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.595473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.596365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.596651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.596930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.602858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.604351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:12.606438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 127/264] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:12 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:12.615196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.701460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:12.770828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:12.794820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411947-b54e-46a9-bd4a-7ff7ef3d6325 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.841844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.841844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.841844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.841844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] PATH_INFO: `/v3/users/9c693e681635488e8016f1c46825d165` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.842240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9c693e681635488e8016f1c46825d165)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.843045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:12.845164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 138/265] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:12 2022] GET /identity/v3/users/9c693e681635488e8016f1c46825d165 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:12.852242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:12.885558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ea0c-cbde-4796-b135-10eb42e62e18 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:12.928297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:12.929360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:12.929748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:12.930169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/665c4a21440b4d8a881c648df11bff38/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:12.932762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, user_id=665c4a21440b4d8a881c648df11bff38, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:12.934443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:13.056624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b6207-4054-48df-bbeb-5326cedfe0a9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:13.066686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 128/266] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:54:12 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/665c4a21440b4d8a881c648df11bff38/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:13.138783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:13.158103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:13.159345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:13.159773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:13.160387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:13.335872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:13.338995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:13.555167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 139/267] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:13.561594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:13.703232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b1ea-5bd3-470c-acc1-697259a31bec None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:13.706330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:13.747877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:13.748774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:13.749042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:13.749417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:13.750846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:13.752421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe722aa-92d9-44c0-9008-38271a83544e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:13.754358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 129/268] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:13 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:13.760762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:13.806420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:13.942287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc733-ec48-4535-8846-337a7b5821cf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:14.038905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:14.040566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:14.041359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:14.042177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:14.044611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=9c693e681635488e8016f1c46825d165) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:14.045500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:14.048722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385411-591b-4e5f-96d7-05ca036d41db None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:14.067933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 140/269] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:13 2022] GET /identity/v3/role_assignments?user.id=9c693e681635488e8016f1c46825d165&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=51263ee5485341fa98c78d57f2d235fb => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:14.942098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28f76-b20b-4e46-8f9b-27aa48897faa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:14.943223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28f76-b20b-4e46-8f9b-27aa48897faa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:14.943727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28f76-b20b-4e46-8f9b-27aa48897faa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:14.945720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 130/270] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:14.952405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494b39-26da-4f14-b3c4-39dd4603fa1d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:14.953019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494b39-26da-4f14-b3c4-39dd4603fa1d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:14.953490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494b39-26da-4f14-b3c4-39dd4603fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:14.979967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-51494b39-26da-4f14-b3c4-39dd4603fa1d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:14.982705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-51494b39-26da-4f14-b3c4-39dd4603fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:15.051703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe57e1-bca2-44c9-a74d-07a4779cc89b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.052163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe57e1-bca2-44c9-a74d-07a4779cc89b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.052313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe57e1-bca2-44c9-a74d-07a4779cc89b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.054111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 131/271] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:15.060864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.061605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.062090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.099395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:15.100776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:15.128160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 141/272] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:15.130390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476f8c-940e-4d4c-bdcf-d643ba4093bc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.130908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476f8c-940e-4d4c-bdcf-d643ba4093bc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.131424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476f8c-940e-4d4c-bdcf-d643ba4093bc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.133100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 142/273] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:15.145637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.145637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.145637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.178388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:15.180629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:15.205611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 132/274] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:15.205611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.219349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:15.333637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 143/275] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:15.340429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.348077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9aba-ef52-448c-a688-ecfab3ba1261 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:15.352926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:15.397144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:15.398428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.398714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.399222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.413210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:15.421886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:15.426008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 133/276] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:15.426862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.507222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba894e-5db4-4c57-a091-3ed86a831be6 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:15.558799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:15.562205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.562205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.562455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.568079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad4cb-e40e-48fe-928b-801088c3dc60 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:15.576307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:15.584369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:15.585358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:15.586798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 144/277] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:15.587669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.605617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:15.613898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:15.618816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.618816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.618816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.618816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:15.618816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:15.619805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 134/278] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:15.620855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.658088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:15.749100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fbcf8-3901-4504-956f-7d55614aa0f9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:15.769805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d60aeb-5bde-4720-a454-d541aeae5c63 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:15.797767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:15.798990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.799504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.800011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.801468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:15.802059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:15.804601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:15.821890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 145/279] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:15.823526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.841746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:15.842947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:15.843472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:15.843965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:15.845408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:15.846012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:15.848521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:15.864609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 135/280] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:15.865976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:15.945623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:15.983214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15baf-2df3-4ddb-93ac-ad2c3a64e1b2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.026297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:16.040766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d73b4-ff0b-4b6f-93ea-6df9222eed42 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.043242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.044652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.044947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.045306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.046328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.047858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:16.104459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.105368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.105688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.105963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] PATH_INFO: `/v3/users/c89684186135491099444d56cf97a3a3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.107955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] RBAC: Authorizing `identity:get_user(user_id=c89684186135491099444d56cf97a3a3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.109509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:16.111694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 136/281] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:15 2022] GET /identity/v3/users/c89684186135491099444d56cf97a3a3 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:16.112346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:16.179855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 146/282] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:15 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:16.179855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:16.287229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b4965-02f7-4c39-80d3-063ac9aa6300 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.359233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b2b8-0431-4ae4-99d9-e62a5f99e5c8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.364975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.365920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.366196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.366476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] PATH_INFO: `/v3/users/bce36701e26846cb84b9b1e733d551fd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.388103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] RBAC: Authorizing `identity:get_user(user_id=bce36701e26846cb84b9b1e733d551fd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.390917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cde29-5e3c-4a6d-9471-8d19014eb55e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:16.393911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 137/283] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:16 2022] GET /identity/v3/users/bce36701e26846cb84b9b1e733d551fd => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:16.396270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65dcd2-230b-4605-a748-6d0631618b44 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.396765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65dcd2-230b-4605-a748-6d0631618b44 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.397278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65dcd2-230b-4605-a748-6d0631618b44 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.402125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 138/284] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:16.404142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65dcd2-230b-4605-a748-6d0631618b44 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:16.406364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:16.417297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.421279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.421279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.421279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.423228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.425899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2d80d-0541-40eb-8a69-93a17e7a08dc None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:16.429108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 147/285] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:16 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:16.432803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.433224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.433386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.444991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:16.458962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:16.462167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:16.577714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 148/286] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:16.578594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:16.579969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65dcd2-230b-4605-a748-6d0631618b44 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.638894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.639817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.640103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.640652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.641515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, user.id=bce36701e26846cb84b9b1e733d551fd, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:16.641902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.643387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:16.650604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 139/287] 10.222.0.60 () {56 vars in 1308 bytes} [Mon Jul 11 13:54:16 2022] GET /identity/v3/role_assignments?user.id=bce36701e26846cb84b9b1e733d551fd&scope.system=all&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:16.651493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:16.843514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723496f-32bb-48d7-a17b-8343b6587fb7 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.916875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:16.932565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:16.952818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67bda-a903-4bf9-8897-fbe98c63add5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:16.967439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:16.969048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:16.969547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:16.970088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/c89684186135491099444d56cf97a3a3/roles/37be87e2fc4744a0ae6b50111e736800` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:16.986211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, user_id=c89684186135491099444d56cf97a3a3, role_id=37be87e2fc4744a0ae6b50111e736800)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:16.989148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:17.052113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:17.053562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:17.054151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:17.054613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:17.079745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:17.082951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 149/288] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:54:16 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/users/c89684186135491099444d56cf97a3a3/roles/37be87e2fc4744a0ae6b50111e736800 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:17.088393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:17.089337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:17.090170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 140/289] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:17.098556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:17.364852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb991e-4abd-4f1a-8fd5-aafd9696c134 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:17.437736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:17.438697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:17.439098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:17.439486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:17.440634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:17.441077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:17.443300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:17.459122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 150/290] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:17.464507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:17.674155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a266c-9760-41e4-8a55-599ad49e4ba7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:17.750839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:17.752852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:17.753638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:17.754407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] PATH_INFO: `/v3/users/665c4a21440b4d8a881c648df11bff38` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:17.763764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] RBAC: Authorizing `identity:get_user(user_id=665c4a21440b4d8a881c648df11bff38)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:17.767203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:17.771338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 141/291] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:17 2022] GET /identity/v3/users/665c4a21440b4d8a881c648df11bff38 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:17.777200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:17.934014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:18.073177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227597-b659-41b5-ac72-9b9006523d85 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:18.202035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:18.203740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:18.204548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:18.205346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:18.454698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:18.458832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:18.579009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:18.679136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 151/292] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:18.684985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:18.731752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:19.018631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ec93-1ff1-4733-93b6-f644113511ce None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:19.115924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:19.117210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.117741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.118213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.123251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:19.125184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af85e75-5e48-43aa-9a58-e03e7c5d9e8a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:19.127459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 142/293] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:18 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:19.139312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:19.338442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90186-3951-4273-a744-2569abcb0f1b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:19.422350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:19.423045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.423332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.423612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.424471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=665c4a21440b4d8a881c648df11bff38) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:19.424788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:19.426493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fe4c-3c46-47c3-aab4-85dffe9dfbc9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:19.440511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 152/294] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:19 2022] GET /identity/v3/role_assignments?user.id=665c4a21440b4d8a881c648df11bff38&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:19.730000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666242-f1a1-4d61-8be0-8953f8700a40 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.731054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666242-f1a1-4d61-8be0-8953f8700a40 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.732131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666242-f1a1-4d61-8be0-8953f8700a40 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.734226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 143/295] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:19.740246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b09cc-d1da-4912-8d36-a26fd9d4ec7c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.740769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b09cc-d1da-4912-8d36-a26fd9d4ec7c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.740844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b09cc-d1da-4912-8d36-a26fd9d4ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.770762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c49b09cc-d1da-4912-8d36-a26fd9d4ec7c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:19.772015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c49b09cc-d1da-4912-8d36-a26fd9d4ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:19.788505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:19.880526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 153/296] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:19.905428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666242-f1a1-4d61-8be0-8953f8700a40 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:19.915479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f072b-2281-4450-b944-b70994705635 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.915758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f072b-2281-4450-b944-b70994705635 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.916233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f072b-2281-4450-b944-b70994705635 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.918165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 154/297] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:19.925243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:19.925803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:19.926224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:19.953866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:19.956074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:20.022019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:20.051028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666242-f1a1-4d61-8be0-8953f8700a40 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.062985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 155/298] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:20.092196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.096927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.096927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.096927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.096927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.097452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:20.099186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:20.101358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 144/299] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:20.107964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.210765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:20.254232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc772-f8c4-49f5-bdc8-c1628f54632e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.259540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc53b6-7a8a-45da-9dd0-40cf35ea5feb None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.299424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.300527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.301033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.301568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.302538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:20.304763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6654d5-bee3-410d-b858-ef11d12d85fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:20.338120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.339226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.339552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.339896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.360615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:20.377495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:20.378465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:20.379239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:20.385141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 156/300] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:20.388808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.422104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 145/301] 10.222.0.60 () {60 vars in 1134 bytes} [Mon Jul 11 13:54:20 2022] POST /identity/v3/groups => generated 229 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:20.474025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a2a7-7a73-4e68-8fbb-35cc1fe02467 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.474453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a2a7-7a73-4e68-8fbb-35cc1fe02467 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.474603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a2a7-7a73-4e68-8fbb-35cc1fe02467 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.476265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 146/302] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:20.486538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5ded0-0b48-49be-b709-edabc6f48394 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.487622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5ded0-0b48-49be-b709-edabc6f48394 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.488452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5ded0-0b48-49be-b709-edabc6f48394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.511624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:20.522123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-48e5ded0-0b48-49be-b709-edabc6f48394 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:20.525042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48e5ded0-0b48-49be-b709-edabc6f48394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:20.609806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b460-7f5d-4ecf-9f74-8ab05f488713 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.642470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 147/303] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:20.644011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4058d1-4abd-49b3-b849-5a9091a2b81b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.644300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4058d1-4abd-49b3-b849-5a9091a2b81b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.644573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4058d1-4abd-49b3-b849-5a9091a2b81b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.650151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 148/304] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:20.656844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.657147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.657455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.670776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.671689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.672016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.672359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.673037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:20.673348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:20.675668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:20.676638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:20.679390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:20.680645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:20.693992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 157/305] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:20.695158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.770111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 149/306] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:20.771808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.845912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb0a3-d17e-4e2b-86b0-b3dcb0820936 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.873885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:20.894079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.894940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.895223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.895505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:20.911599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:20.921227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:20.922319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:20.923293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:20.930789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 158/307] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:20.931369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7f9c-6a9e-4d6e-aefe-57299e284e44 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:20.932164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:20.980009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:20.980964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:20.981809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:20.982207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] PATH_INFO: `/v3/users/6389af4f0603476fae908b3244ac1ce8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.003619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] RBAC: Authorizing `identity:get_user(user_id=6389af4f0603476fae908b3244ac1ce8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.005244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.007091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 150/308] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:20 2022] GET /identity/v3/users/6389af4f0603476fae908b3244ac1ce8 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:21.007913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.017074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:21.090608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4336c3a-748c-491c-a5d5-6330655fffc2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.136015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.136725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.137016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.137297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.149908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:21.158493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:21.160110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 159/309] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:21.161892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.203627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2a34-952c-43a1-993f-989ed911e27a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.244135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:21.261899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.263341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.263805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.264213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.265274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:21.265835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.267673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.281821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 151/310] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:21.285856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.336904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c293-5d24-4b86-ad12-f83d69aae296 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.359733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:21.390455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.391420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.391885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.392328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.394602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, user.id=6389af4f0603476fae908b3244ac1ce8, scope.system=all) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:21.395648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.399782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.421615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 160/311] 10.222.0.60 () {56 vars in 1308 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/role_assignments?user.id=6389af4f0603476fae908b3244ac1ce8&scope.system=all&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:21.421615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.435380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e022-981e-48e8-8a56-a5ad3e8f72d4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.495597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.496662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.498258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.498690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.500004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:21.500429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.502843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.518893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 152/312] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:21.527296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.630052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:21.646748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db7e4b-1bef-46db-b56f-09aa3cfca2b3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.726581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.728187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.728950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.729550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] PATH_INFO: `/v3/users/c89684186135491099444d56cf97a3a3` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.732517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c89684186135491099444d56cf97a3a3)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.736028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.739295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7760-659f-43f2-83f5-51b64216e5a0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:21.739802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 161/313] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/users/c89684186135491099444d56cf97a3a3 => generated 297 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:21.753185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.828239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:21.831313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:21.832164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:21.832871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] PATH_INFO: `/v3/users/bce36701e26846cb84b9b1e733d551fd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:21.835473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=bce36701e26846cb84b9b1e733d551fd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:21.838673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:21.843139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 153/314] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/users/bce36701e26846cb84b9b1e733d551fd => generated 293 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:21.855571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:21.874146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:21.977654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285529-44cb-41c8-abf7-7f110466e5f9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:22.049286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:22.050043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:22.050333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:22.050615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:22.067306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b9c9-26a8-4817-a6dd-cbc0ab4b4ab5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:22.101490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:22.138353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:22.141478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:22.142396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:22.143172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] PATH_INFO: `/v3/system/users/bce36701e26846cb84b9b1e733d551fd/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:22.147558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bce36701e26846cb84b9b1e733d551fd, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:22.151966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:22.161054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:22.164613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:22.245619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 154/315] 10.222.0.60 () {58 vars in 1334 bytes} [Mon Jul 11 13:54:21 2022] PUT /identity/v3/system/users/bce36701e26846cb84b9b1e733d551fd/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:22.261980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:22.373477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 162/316] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:22.385477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:22.557731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853d2a-203e-4233-abaa-6c94bc59ee07 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:22.633676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:22.635223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:22.635728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:22.636229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:22.638939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:22.642022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae08a-eeae-4948-a07c-8e0163ac68e9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:22.646178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 155/317] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:22 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:22.652913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:22.780482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce479-c6ae-40d4-85b9-d302856fd4db None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:22.831112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:22.831752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:22.832040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:22.832316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:22.833227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, scope.project.id=74662fff99564ec2be1aacb12ca800b4, user.id=c89684186135491099444d56cf97a3a3) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:22.833545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:22.835094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27120d09-9a1a-4ec2-9df8-a7b89bfea1aa None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:22.843956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 163/318] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:22 2022] GET /identity/v3/role_assignments?user.id=c89684186135491099444d56cf97a3a3&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:23.009001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45e2a-40a9-4d67-b050-97a844747fb2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:23.009866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45e2a-40a9-4d67-b050-97a844747fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:23.009866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45e2a-40a9-4d67-b050-97a844747fb2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:23.011448 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 156/319] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:23.017887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:23.018617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:23.018617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:23.042194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:23.043472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:23.053977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:23.176018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 164/320] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:23.198472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc45e2a-40a9-4d67-b050-97a844747fb2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:23.264040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:23.330672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc45e2a-40a9-4d67-b050-97a844747fb2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:23.392450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:23.393890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:23.394416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:23.394932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:23.397270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:23.400117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb5882-08bb-4bc7-9773-cde1e32db9cc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:23.404085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 157/321] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:23.413227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:23.590407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de67be-818b-43c5-9945-fac9cb44ffb0 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:23.650772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:23.651499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:23.651933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:23.652108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] PATH_INFO: `/v3/groups` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:23.652783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:23.654840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fffc04-1f14-450a-97e2-ff8dd89e25e4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:23.762758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 165/322] 10.222.0.60 () {60 vars in 1134 bytes} [Mon Jul 11 13:54:23 2022] POST /identity/v3/groups => generated 226 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:24.062204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b152-8a66-4796-9f03-7d0461e36656 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:24.062934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b152-8a66-4796-9f03-7d0461e36656 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:24.062934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b152-8a66-4796-9f03-7d0461e36656 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:24.064508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 158/323] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:24.070639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:24.071370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:24.071370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:24.081307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:24.094259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:24.095499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:24.203595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 166/324] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:24.227491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571b152-8a66-4796-9f03-7d0461e36656 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:24.464394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571b152-8a66-4796-9f03-7d0461e36656 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:24.502335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:24.546806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:24.550408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:24.551295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:24.552013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:24.576264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:24.595626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:24.597440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:24.599245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:24.603635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 159/325] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:24.610046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:24.755777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9327f-90e2-40a0-b97d-57156c9118bf None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:24.794140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:24.803824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:24.804522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:24.804804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:24.805076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:24.813942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:24.813942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:24.813942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:24.819057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 167/326] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:24.826370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:25.070275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf99988-8e48-4898-af8a-fc2fba2265b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:25.134516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:25.135443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:25.135725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:25.136001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] PATH_INFO: `/v3/users/6389af4f0603476fae908b3244ac1ce8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:25.138486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] RBAC: Authorizing `identity:get_user(user_id=6389af4f0603476fae908b3244ac1ce8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:25.140392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65163e-5b60-4ace-a3ee-8dee2a368a73 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:25.142654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 160/327] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:24 2022] GET /identity/v3/users/6389af4f0603476fae908b3244ac1ce8 => generated 293 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:25.149225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:25.319807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51ce9b-a880-43a3-9e2e-ce71fd2d8a43 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:25.369078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:25.369908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:25.370443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:25.370717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] PATH_INFO: `/v3/system/users/6389af4f0603476fae908b3244ac1ce8/roles/37be87e2fc4744a0ae6b50111e736800` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:25.373508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6389af4f0603476fae908b3244ac1ce8, role_id=37be87e2fc4744a0ae6b50111e736800)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:25.375002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cfdbf-e30f-4ab1-8b01-f8c48fa09cc2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:25.459579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 168/328] 10.222.0.60 () {58 vars in 1334 bytes} [Mon Jul 11 13:54:25 2022] PUT /identity/v3/system/users/6389af4f0603476fae908b3244ac1ce8/roles/37be87e2fc4744a0ae6b50111e736800 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 13:54:25.579492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5079-10b4-42c2-abd3-463751cc375a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:25.579914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5079-10b4-42c2-abd3-463751cc375a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:25.580088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5079-10b4-42c2-abd3-463751cc375a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:25.581815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 161/329] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:25.601159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:25.601556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:25.601750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:25.627305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:25.628436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:25.718162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:25.739179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 169/330] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:25.842940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5079-10b4-42c2-abd3-463751cc375a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:25.916681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:26.016134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5079-10b4-42c2-abd3-463751cc375a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:26.067810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:26.068638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:26.068996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:26.069276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:26.086444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:26.103231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:26.104947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:26.106557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:26.107535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 162/331] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:26.115416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:26.360563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6eec4-fba4-4b82-bee3-288ae66d9101 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:26.441259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:26.441991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:26.442273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:26.442569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:26.443320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:26.443627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:26.445085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:26.456593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 170/332] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:26.462240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:26.605435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7446f-a165-47c5-942a-c993e6b21ac2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:26.611189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:26.650563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:26.651490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:26.652419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:26.652700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] PATH_INFO: `/v3/users/bce36701e26846cb84b9b1e733d551fd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:26.655576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] RBAC: Authorizing `identity:get_user(user_id=bce36701e26846cb84b9b1e733d551fd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:26.657188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494167-ad66-49dd-816b-6d7c46c8c984 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:26.661940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 163/333] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:26 2022] GET /identity/v3/users/bce36701e26846cb84b9b1e733d551fd => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:26.665750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:26.814722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:26.913986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62470-3c97-40aa-87a0-d185e207de1f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:26.957137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:26.957843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:26.958116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:26.958393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:26.959244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] RBAC: Adding query filter params (role.id=fb91a1eacf104c9ba3b62a4193b75e97, user.id=bce36701e26846cb84b9b1e733d551fd, scope.system=all) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:26.959554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:26.961113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69807-8247-4615-8a1f-bc7896cee2b4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:26.978706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 171/334] 10.222.0.60 () {56 vars in 1308 bytes} [Mon Jul 11 13:54:26 2022] GET /identity/v3/role_assignments?user.id=bce36701e26846cb84b9b1e733d551fd&scope.system=all&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 510 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:28.690267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5243-c04b-430e-8c56-f24c0a27ab45 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:28.691144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5243-c04b-430e-8c56-f24c0a27ab45 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:28.691563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5243-c04b-430e-8c56-f24c0a27ab45 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:28.693514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 164/335] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:28.698982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfe2-5c41-4b84-b7d7-9d62f4115156 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:28.700533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfe2-5c41-4b84-b7d7-9d62f4115156 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:28.700989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adfe2-5c41-4b84-b7d7-9d62f4115156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:28.723724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-946adfe2-5c41-4b84-b7d7-9d62f4115156 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:28.725236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-946adfe2-5c41-4b84-b7d7-9d62f4115156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:28.829877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 172/336] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:28.881305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5243-c04b-430e-8c56-f24c0a27ab45 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:29.057595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5243-c04b-430e-8c56-f24c0a27ab45 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:29.076168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720f76-0b3d-4fa7-9e40-0855902f71dc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.076892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720f76-0b3d-4fa7-9e40-0855902f71dc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.077365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720f76-0b3d-4fa7-9e40-0855902f71dc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.079068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 173/337] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:29.099345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.099985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.100486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.127451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:29.129041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:29.137126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:29.138694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.139197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.139697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.174766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:29.175443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:29.197029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:29.198035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:29.198808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:29.202390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 165/338] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:29.209675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:29.304240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 174/339] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:29.327084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:29.387560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:29.408260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35784a-4bbc-4141-a456-5acdc27faca4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:29.460225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:29.460918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.461198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.461565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.462364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:29.462670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:29.464092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:29.483268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 166/340] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:29.490946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:29.628786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:29.638011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6e6c-b170-40d6-8cc7-25d48c0db9b5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:29.687212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:29.687890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.688232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.688510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.737203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5b7d-8e03-469e-b9d4-2b7e13c8011d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:29.792937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:29.795394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.795929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.796624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.810658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-25fdb8b8-6542-4596-a9a4-79067bf0d6e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:29.821139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:29.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:29.822897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:29.826313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 175/341] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:29.828146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3259-b5d9-41d6-a2b3-39a60167a0a1 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.828666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3259-b5d9-41d6-a2b3-39a60167a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.829143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db3259-b5d9-41d6-a2b3-39a60167a0a1 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.831257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 176/342] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:29.832725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf1cb-03c2-4dce-9619-6734c2e25055 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.833214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf1cb-03c2-4dce-9619-6734c2e25055 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.833754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf1cb-03c2-4dce-9619-6734c2e25055 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.839788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 177/343] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:29.841599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:29.842854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:29.843376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:29.848808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:29.851288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f6928-55ba-400c-bf62-9bed5117bd7d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:29.868742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:29.870464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:29.916298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:29.998951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 178/344] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:30.000521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.024014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:30.037488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 167/345] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:54:30.037488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f65d-8e19-4af1-9c89-0004ab96464b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.037825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f65d-8e19-4af1-9c89-0004ab96464b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.038092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f65d-8e19-4af1-9c89-0004ab96464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.062864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4413f65d-8e19-4af1-9c89-0004ab96464b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:30.064395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4413f65d-8e19-4af1-9c89-0004ab96464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:30.167643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f7909-f983-4705-8dc3-deb01829bf26 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:30.171362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 168/346] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:30.174408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a19d-930c-456e-9fd6-8e9d8984b58e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.174919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a19d-930c-456e-9fd6-8e9d8984b58e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.175425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a19d-930c-456e-9fd6-8e9d8984b58e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.185789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 169/347] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:30.188066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a19d-930c-456e-9fd6-8e9d8984b58e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.217229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:30.218467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.218790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.219239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.220584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:30.221365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:30.223851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:30.237612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 179/348] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:30.238380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.272173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:30.384676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a19d-930c-456e-9fd6-8e9d8984b58e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:30.385091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca63d21-f0e6-4469-a1e2-3e4151d3bf72 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:30.430718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:30.449095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:30.451002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.451475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.451884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.460986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:30.462594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.463121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.463671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.466669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:30.469956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fda61-f655-4c0c-8690-79f0e679f941 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:30.471252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:30.473925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 180/349] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:30 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:30.476243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d7a8-ddd7-437f-a534-3102f6ded00e None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.476774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d7a8-ddd7-437f-a534-3102f6ded00e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.477288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d7a8-ddd7-437f-a534-3102f6ded00e None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.480498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 181/350] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:30.483190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.483903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.484580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:30.484720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:30.486191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 170/351] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:30.487808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.521066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:30.523013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:30.659902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 182/352] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:30.661901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.678967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745ed8-5642-4387-983c-8f491b1eb258 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:30.699928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:30.744053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:30.745677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.746130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.746798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.767875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:30.780720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:30.782675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 171/353] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:30.784369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:30.868187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd216f-ce56-4ac7-b3a4-0306aed5f247 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:30.872884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:30.926302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:30.927366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:30.927820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:30.928815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:30.972148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3025-74e7-4567-982e-c0cb93eaad2a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.040376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.042174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.042629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.043024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.052050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:31.054645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:31.056089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:31.057876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4131c-699b-4720-a0fe-23efc301b220 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:31.066852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 172/354] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:30 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:31.066852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.066852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.066852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.091754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:31.107109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:31.112685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:31.210387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 173/355] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:31.214452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.260296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 183/356] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:31.265174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.290365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:31.383916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22a93-cc62-4ade-9f8b-7e1b37806c94 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.438224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26c3f-9335-4a43-bd11-6ab158a93497 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.442601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.443920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.444332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.444706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.446065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:31.447753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:31.449119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:31.463920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 174/357] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:31.464551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.478190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:31.501718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.506509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.506509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.506509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.521687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:31.532203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:31.534114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:31.535785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 184/358] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:31.537243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.647507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:31.653921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1cfad-d4c0-4ba4-bea2-ab95bf11d14d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.705727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182355-0218-4e2e-a602-119e8a0632a6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.710783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.711598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.711969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.712325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.713167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:31.713554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:31.716513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:31.726620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 175/359] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:31.727536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.758145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.758833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.759124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.759405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.760256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=2952813ddae54de5b5ddb512178a815c) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:31.760577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:31.762233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:31.768993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 185/360] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=51263ee5485341fa98c78d57f2d235fb => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:31.769722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:31.867921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:31.916750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23b58b-49e1-4d31-9dcc-f93a67e281cd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:31.975672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:31.977203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:31.977630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:31.978099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:31.990220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d34e9-5d5b-4699-9df0-211ed145b83f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.001235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:32.018554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:32.022129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:32.024650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 176/361] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:32.027400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.063776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:32.068569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.070176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.070696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.071182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.073565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.085005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.085005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 186/362] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:31 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:32.085005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.192659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1ddd3-b950-4f8b-adac-410c8a5ae7ae None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.236562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.237503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.237659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.237891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.260401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09af2f-c98e-4803-8916-2c135f93e5a5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.283095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:32.321413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.325813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.325813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.325813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.325813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:32.325813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.327805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.344478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 187/363] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:32.344478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.357964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.360724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.393350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:32.497188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 177/364] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:32.498109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.512418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e1d5-e40f-4c69-a381-2b2c0d8d666f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.577065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.578419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.578897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.579510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.627246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78552-3f9d-4af3-b572-afa73435c3a1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.655843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:32.657166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:32.670940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.671636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.671947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.672226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.672993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:32.673326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.674905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.696263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.702210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 178/365] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:32.702383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.702488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.854158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 188/366] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:32.856220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.873706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50052eb8-2368-437d-8e7d-a54e7ea501d3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:32.924206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:32.925069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:32.925366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:32.925897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:32.928287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:32.931579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:32.934881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 179/367] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:32.936180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:32.997152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.021375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.043741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ba584-d34c-4981-800f-2ba9e73b8d7a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.093603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.094565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.094839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.095117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] PATH_INFO: `/v3/users/6389af4f0603476fae908b3244ac1ce8` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.096494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] RBAC: Authorizing `identity:get_user(user_id=6389af4f0603476fae908b3244ac1ce8)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.098005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.099980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 189/368] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/users/6389af4f0603476fae908b3244ac1ce8 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:33.105783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.124388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a7584-7ad1-4b3d-bba8-01b3039ae1bd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.195713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.197285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.197791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.198259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.200749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.203329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.206656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 180/369] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:32 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:33.211703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.268269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641ba6-cda8-4cd7-b2d2-b99daf14cb75 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.314146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.314953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.315275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.315522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.330876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.409538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f82b8-e9d6-4ec0-8af1-a80b5aba5d8e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.425607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.427346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.453632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.491318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.493246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.494437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.495826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.500624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.504882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.516563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 181/370] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:33.516563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.566843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 190/371] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:33.568783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.649154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.710141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0524-7ff0-4430-9ffb-6c758d88ada8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.739714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede6289-2de4-4280-9b1f-f1006c25fd79 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:33.757229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=2952813ddae54de5b5ddb512178a815c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.764785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.777708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 182/372] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:33.777708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.808466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:33.809388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:33.809896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:33.810721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:33.811972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] RBAC: Adding query filter params (role.id=37be87e2fc4744a0ae6b50111e736800, user.id=6389af4f0603476fae908b3244ac1ce8, scope.system=all) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:33.812423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:33.814189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:33.832217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 191/373] 10.222.0.60 () {56 vars in 1308 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/role_assignments?user.id=6389af4f0603476fae908b3244ac1ce8&scope.system=all&role.id=37be87e2fc4744a0ae6b50111e736800 => generated 510 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:33.833457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:33.912000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:33.973246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb5be-738e-4b8e-a093-e66e6d0eb1c3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.040834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.041766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.042051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.042331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.043799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.045572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.047906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 183/374] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.048890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.058105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:34.068480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc5adb-cfcd-4fb2-8a6c-d4c985394512 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.120325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.121828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.122117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.122393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.123882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.125736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe67b-cdd1-4cdb-95cd-e1082c048849 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.129111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 192/375] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:33 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.130787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cc98c-90d3-4331-b0b2-ac163e39cb05 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.131084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cc98c-90d3-4331-b0b2-ac163e39cb05 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.131364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cc98c-90d3-4331-b0b2-ac163e39cb05 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.137445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 193/376] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:34.138768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cc98c-90d3-4331-b0b2-ac163e39cb05 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.256347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0aa22-77d2-460b-8e36-4e7fded0e685 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.309769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:34.319040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cc98c-90d3-4331-b0b2-ac163e39cb05 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.336414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.338173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.338786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.339394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] PATH_INFO: `/v3/projects/860ed82bdecd4cd588b102fbafc7b011` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.342106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] RBAC: Authorizing `identity:get_project(project_id=860ed82bdecd4cd588b102fbafc7b011)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.345287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.349011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 184/377] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/projects/860ed82bdecd4cd588b102fbafc7b011 => generated 344 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.358850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.373353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.374100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.374388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.374667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.375529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=74662fff99564ec2be1aacb12ca800b4) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:34.375841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.378351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ef08-0baf-4f43-a3e0-8f730b9bd4cd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.394398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 194/378] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=51263ee5485341fa98c78d57f2d235fb => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.394398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.394398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.394398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.425484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:34.427327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:34.477857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:34.535057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae31fb-bf25-456c-85e1-9d64f8b8e94c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.599878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 195/379] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:34.601522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.632688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.634206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.634672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.635122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.636969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=74662fff99564ec2be1aacb12ca800b4) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:34.637548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.640691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.649211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 185/380] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.650490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.732409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:34.758740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc53fc-8ca4-40ea-bea1-111cbe3a409f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.812830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.815337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.816204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.819868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] PATH_INFO: `/v3/groups/3973c7b4ce63426684eb0d4af4d784b5` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:34.832014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] RBAC: Authorizing `identity:get_group(group_id=3973c7b4ce63426684eb0d4af4d784b5)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:34.834294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:34.837390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 196/381] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/groups/3973c7b4ce63426684eb0d4af4d784b5 => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:34.849328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:34.865099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745604-5e41-436a-b817-d117c5aad700 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:34.921741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:34.964645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:34.966124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:34.975613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:34.975613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:35.003439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:35.018087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:35.019990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:35.021607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:35.027650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 186/382] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:35.033659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deea09a-8eb0-47fc-9107-d20f158bc402 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:35.039349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:35.109969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:35.111056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:35.111580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:35.117606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:35.117606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] RBAC: Adding query filter params (group.id=3973c7b4ce63426684eb0d4af4d784b5, role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=860ed82bdecd4cd588b102fbafc7b011) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:35.117606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:35.118240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:35.131533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 197/383] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:34 2022] GET /identity/v3/role_assignments?group.id=3973c7b4ce63426684eb0d4af4d784b5&scope.project.id=860ed82bdecd4cd588b102fbafc7b011&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:35.272029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9463af-049a-443c-a863-faed8dd16b12 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:35.298933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:35.327861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:35.328561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:35.328848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:35.329128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:35.330042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:35.330359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:35.331922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:35.348079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 187/384] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:35.354921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:35.542395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:35.566883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b837e-e855-4bcd-a977-e83c0e5d8178 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:35.634982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:35.636548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:35.637624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:35.638125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:35.640482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:35.643462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:35.647062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 198/385] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:35 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:35.653619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:35.870465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281645f-f43c-4345-9514-5d57cac0173f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:35.941833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:35.943358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:35.943857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:35.944345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:35.946682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:35.950008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2632a-c730-425b-b301-ef2e2c647e39 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:35.953799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 188/386] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:35 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:35.962627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:36.148948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17acba3-a63e-4f1c-9b92-83a42af444c3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:36.203184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:36.204117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:36.204399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:36.204675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/groups/f18120b80f924ee4aafb628837054048/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:36.207266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, group_id=f18120b80f924ee4aafb628837054048, role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:36.208769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc67a-3673-49be-ba26-6f42ca007af7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:36.287820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 199/387] 10.222.0.60 () {58 vars in 1442 bytes} [Mon Jul 11 13:54:35 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/groups/f18120b80f924ee4aafb628837054048/roles/51263ee5485341fa98c78d57f2d235fb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:36.834854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168174bd-491e-4d9f-823c-9052abcf8f55 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:36.835380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168174bd-491e-4d9f-823c-9052abcf8f55 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:36.835812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168174bd-491e-4d9f-823c-9052abcf8f55 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:36.838921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 189/388] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:36.846336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455748-e9db-4cf5-8b34-3e97fd1735a8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:36.846841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455748-e9db-4cf5-8b34-3e97fd1735a8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:36.847346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455748-e9db-4cf5-8b34-3e97fd1735a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:36.891565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-87455748-e9db-4cf5-8b34-3e97fd1735a8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:36.893813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-87455748-e9db-4cf5-8b34-3e97fd1735a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:36.920048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:37.067006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 200/389] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:37.103678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168174bd-491e-4d9f-823c-9052abcf8f55 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:37.204039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:37.330329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168174bd-491e-4d9f-823c-9052abcf8f55 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:37.361706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c42054-e043-40a0-9874-857481b45e8f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:37.362244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c42054-e043-40a0-9874-857481b45e8f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:37.362244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c42054-e043-40a0-9874-857481b45e8f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:37.363903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 201/390] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:37.370705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:37.371438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:37.371934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:37.388315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:37.389802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:37.390320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:37.390796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:37.394827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:37.396848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:37.434661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:37.446201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:37.447236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:37.448041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 190/391] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:37.455614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:37.492676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 202/392] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:37.539093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:37.650108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a557-a7a1-40c9-ad27-6ddadc9d477e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:37.653960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:37.705997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:37.728894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:37.729607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:37.729916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:37.730311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:37.731565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:37.731898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:37.733370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:37.738243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2fde0-711c-44ca-b6f3-43154871b1ab None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:37.755291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 191/393] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:37.765025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:37.820045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:37.821146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:37.821619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:37.822158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:37.835651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:37.845200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:37.846160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:37.846932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:37.853713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 203/394] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:37.857056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:37.940122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1c5c-2efe-4e87-a489-ab39ba4fc6d8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.016270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.017315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.019334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.019334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.022128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.023752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1bc77-432c-49d5-942b-8d41c936bc65 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.026818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 192/395] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:37 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:38.036088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9ec6-702d-4c16-9e9b-8f2c483f2022 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.036632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9ec6-702d-4c16-9e9b-8f2c483f2022 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.037224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9ec6-702d-4c16-9e9b-8f2c483f2022 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.039406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 193/396] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:38.041505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9ec6-702d-4c16-9e9b-8f2c483f2022 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.066353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9ed03-3408-49d8-9b92-530164fc3f17 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.080356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:38.138427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.139951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.140666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.141323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.142737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:38.143517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.146356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf014-1c59-4704-ac2c-6244f654196b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.151325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:38.163768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 204/397] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:38.166498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.166713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9ec6-702d-4c16-9e9b-8f2c483f2022 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.167526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.168979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.199574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:38.202299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:38.209876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.210768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.211046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.211381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.212957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.215088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.217595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 194/398] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:38 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:38.218649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.298672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 205/399] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:38.299913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.409344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:38.415421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323582-4c16-4d71-8329-8b0cf8ca1d2c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.430077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b29764-5465-42dc-8ec6-2ebf1d8b36f5 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.461756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:38.471768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.472942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.473470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.473922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c/groups/f18120b80f924ee4aafb628837054048/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.476299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=2952813ddae54de5b5ddb512178a815c, group_id=f18120b80f924ee4aafb628837054048, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.478046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.483803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.485322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.486002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.486530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.489039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.492033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a7839-b2c2-4a8b-aa70-d401aa1babbc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.497628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 195/400] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:38 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:38.499226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdca3-c2cf-4fbb-966c-dcf0f6ddc1d2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.499783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdca3-c2cf-4fbb-966c-dcf0f6ddc1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.500358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdca3-c2cf-4fbb-966c-dcf0f6ddc1d2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.503212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 196/401] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:38.504506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cdca3-c2cf-4fbb-966c-dcf0f6ddc1d2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.566114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 206/402] 10.222.0.60 () {58 vars in 1442 bytes} [Mon Jul 11 13:54:38 2022] PUT /identity/v3/projects/2952813ddae54de5b5ddb512178a815c/groups/f18120b80f924ee4aafb628837054048/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:38.567675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.752869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cdca3-c2cf-4fbb-966c-dcf0f6ddc1d2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.774893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4aba-cd31-4141-8c53-10e4e4e28b52 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:38.833932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.836439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.836891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.837340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.856883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:38.867467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:38.867467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.867753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.868515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fa260f99-cdaa-4b18-9883-b66c17de1941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:38.870000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:38.870960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:38.871763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:38.872419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 197/403] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:54:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:38.873984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:38.874585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:38.875068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:38.875551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:38.877248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:38.880198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 207/404] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:38 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:38.881761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:38.916166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:38.916166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:38.957738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:38.987935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:39.049617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 198/405] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:39.049617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.081624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4155-9353-4761-a010-4084d4f1efae None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.126074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.126756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.127041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.127320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.128104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:39.128418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:39.129882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52569e97-1b2b-420e-bb06-ee518e12155d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:39.140359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 208/406] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:39.141842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1814-dde5-4757-87d6-5b37c6d1bd99 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.142158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1814-dde5-4757-87d6-5b37c6d1bd99 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.142439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1814-dde5-4757-87d6-5b37c6d1bd99 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.145924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 209/407] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:39.147319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1814-dde5-4757-87d6-5b37c6d1bd99 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.217132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5338-8553-48a7-8461-3acc64b02d84 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.261921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.262841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.263137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.263422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/groups/f18120b80f924ee4aafb628837054048/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.266655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, group_id=f18120b80f924ee4aafb628837054048, role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:39.268199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1b8a-0dd9-4f4d-b1b4-2410c1040f73 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:39.301790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1814-dde5-4757-87d6-5b37c6d1bd99 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.321748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:39.341270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.342152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.342442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.342739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.356145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:39.364157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:39.367198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:39.367969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:39.371453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 210/408] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:39.372169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.375545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 199/409] 10.222.0.60 () {58 vars in 1442 bytes} [Mon Jul 11 13:54:39 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/groups/f18120b80f924ee4aafb628837054048/roles/51263ee5485341fa98c78d57f2d235fb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:39.387534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.387924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.388371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.439889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:39.442083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:39.471741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:39.555210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bdb26-4e29-40a1-befd-6f016114b6a7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.579490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 200/410] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:39.581044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.613068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.614645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.615191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.615679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] PATH_INFO: `/v3/groups/3973c7b4ce63426684eb0d4af4d784b5` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.617528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] RBAC: Authorizing `identity:get_group(group_id=3973c7b4ce63426684eb0d4af4d784b5)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:39.620045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:39.623037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 211/411] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/groups/3973c7b4ce63426684eb0d4af4d784b5 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:39.625659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.711071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:39.763145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330999d-18f2-471e-a89a-fc32838ad518 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.807852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098519b-bf95-4626-88fb-ffbb1141f9ee None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:39.810034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.810982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.812107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.812573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.813498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:39.814089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:39.815848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:39.826688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 201/412] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:39.827926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.844012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:39.890116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:39.891778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:39.892362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:39.892852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:39.919172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:39.937765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:39.938763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:39.939562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:39.940658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 212/413] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:39.941833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:39.959509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d559b8-80b0-45d1-9593-eee71eea266f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.001560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.003212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.004271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.004790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] PATH_INFO: `/v3/projects/860ed82bdecd4cd588b102fbafc7b011` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.006720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] RBAC: Authorizing `identity:get_project(project_id=860ed82bdecd4cd588b102fbafc7b011)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.008457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.012086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 202/414] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/projects/860ed82bdecd4cd588b102fbafc7b011 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:40.013334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:40.135000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:40.147288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28095ef-2cc3-4869-96b0-888da7050fea None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.156964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:40.177923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda450c-0f52-4f41-85d8-15435ebf8d0c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.192303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.193705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.194216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.194725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.196457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.198307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.201310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 213/415] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:39 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:40.202655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:40.252715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.253928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.254414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.255313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.256794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:40.257389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.260135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.278890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 203/416] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:40.280729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:40.331615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a773f-b0b6-42df-9eed-71eeabcfaaf2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.373987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.375366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.375854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.376330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] PATH_INFO: `/v3/projects/860ed82bdecd4cd588b102fbafc7b011/groups/3973c7b4ce63426684eb0d4af4d784b5/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.378758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] RBAC: Authorizing `identity:create_grant(project_id=860ed82bdecd4cd588b102fbafc7b011, group_id=3973c7b4ce63426684eb0d4af4d784b5, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.380508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.462259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 214/417] 10.222.0.60 () {58 vars in 1442 bytes} [Mon Jul 11 13:54:40 2022] PUT /identity/v3/projects/860ed82bdecd4cd588b102fbafc7b011/groups/3973c7b4ce63426684eb0d4af4d784b5/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:40.463863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:40.501671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf8c7-dab1-453b-9410-9c3871b68936 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.583961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:40.587068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.589088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.589237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.590000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.599224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.602184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.614818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 204/418] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:40 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:40.624522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:40.662637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:40.695568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94b70a-208a-4b06-ba97-fb77d7ddbd96 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:40.750559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:40.751586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:40.752061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:40.752521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:40.870222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:40.872686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:40.921279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:40.966383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84b2a-2325-41f8-8fdb-3e257bc40f85 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:41.074937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:41.076347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.076875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.077383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4/groups/f18120b80f924ee4aafb628837054048/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.079852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] RBAC: Authorizing `identity:create_grant(project_id=74662fff99564ec2be1aacb12ca800b4, group_id=f18120b80f924ee4aafb628837054048, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:41.081786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:41.093618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 215/419] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:41.099877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:41.180462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 205/420] 10.222.0.60 () {58 vars in 1442 bytes} [Mon Jul 11 13:54:40 2022] PUT /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4/groups/f18120b80f924ee4aafb628837054048/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:54:41.313970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0de1f-aaaf-476d-af7e-9dbb550fd2e3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:41.386288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:41.388490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.389001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.389499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.391964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:41.394979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d518d-3428-45d3-94e1-399d0e25b355 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:41.399019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 216/421] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:41 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:41.406625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:41.521909 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:41.562309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9637-9d05-4c65-9643-ed27c91aa1a7 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.563566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9637-9d05-4c65-9643-ed27c91aa1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.564051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9637-9d05-4c65-9643-ed27c91aa1a7 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.566959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 217/422] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:54:41.569272 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8417-c5e2-48b7-bbff-f8e20b63037c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:41.573105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.573517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.573919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.580589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:41.594136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:41.595544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:41.614041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:41.615190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.615645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.616119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.617558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:41.619103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:41.621943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 206/423] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:41 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:41.630808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:41.689202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 218/424] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:41.717149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:41.754844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a7fd-6f59-43d4-b5a0-7db3fc4c5729 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:41.805887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:41.807603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.808977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.809450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.810705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=2952813ddae54de5b5ddb512178a815c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:41.812125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:41.813888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:41.818131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:41.823828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 207/425] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:41 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=51263ee5485341fa98c78d57f2d235fb => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:41.876913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6963c-2542-4973-8eb1-89c358f4d84a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:41.932717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:41.940024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:41.940780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:41.941071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:41.941353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:41.964896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-0b22d1ee-f719-44f0-9ea3-14994ea003e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:41.976403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:41.977384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:41.978246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 219/426] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:41.986049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.144455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a590b6-83d1-4f1b-b52a-2ab0dd7b4c8a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:42.155230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b329a-29e9-4692-99df-dfd0f462952b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.155547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b329a-29e9-4692-99df-dfd0f462952b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.155807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b329a-29e9-4692-99df-dfd0f462952b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.157225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 220/427] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:42.167142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.167445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.167773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.183749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:42.184449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.184730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.185144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.186047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:42.186352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:42.187926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:42.196608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:42.197862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:42.198510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 208/428] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:42.205997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.299049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 221/429] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:42.302508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:42.336195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.381676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462cd1-30d2-4692-ac0b-7fb0f99c5cd6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:42.431852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:42.433353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.433919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.434375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.533722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c16e41-b6bf-4e84-86b9-d8a8d397423b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:42.568591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:42.571768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:42.590049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:42.599006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:42.600484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.601223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.601982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.624880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:42.646598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:42.648729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:42.650816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:42.656199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 222/430] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:42.663078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.678282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:42.726592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 209/431] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:54:42.738096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.845242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd441f-acc7-4e14-94ed-efa03de986b7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:42.915484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:42.917140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:42.918624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:42.919576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:42.921299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:42.922318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:42.925510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:42.943150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 223/432] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:42.948275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:42.972450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2b4a8-b5cc-4cfb-bf15-fda6f78ebc73 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.006216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.036661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.037550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.037878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.038152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] PATH_INFO: `/v3/projects/2952813ddae54de5b5ddb512178a815c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.039468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] RBAC: Authorizing `identity:get_project(project_id=2952813ddae54de5b5ddb512178a815c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.041559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.049018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 210/433] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:42 2022] GET /identity/v3/projects/2952813ddae54de5b5ddb512178a815c => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:43.050495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.075511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794fa0-ad55-4e08-a501-0a999217beae None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.100532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.130211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.131910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.132496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.132978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.226501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.228566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.235268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f2c01-1e41-4103-9d3a-3b395abd5f69 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.291654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.306237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.307390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.307779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.308326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.310790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.312896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.315460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 211/434] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:43.321092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.378412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 224/435] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:43.379254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.459174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01929-e02e-4536-bd4b-8fb4c5b32bd5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.474092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.507807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5feaa9-c020-4373-aae6-692b8fe64263 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.515153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.516191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.516695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.517198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.519002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=2952813ddae54de5b5ddb512178a815c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:43.519545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.521714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c61de-3498-413b-9265-dbe0999a417f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.532201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 212/436] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=2952813ddae54de5b5ddb512178a815c&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:43.534491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01299-c85b-4b90-b43f-869e0e9cfa09 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.535003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01299-c85b-4b90-b43f-869e0e9cfa09 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.535463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01299-c85b-4b90-b43f-869e0e9cfa09 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.537790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 213/437] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:43.546973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.547782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.548480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.557533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.559981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.560809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.561522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.564224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.567355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.571413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 225/438] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:43.577773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.584171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:43.586185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:43.610203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.712967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 214/439] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:43.741421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.781058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354070c6-1f8e-4ed9-8f93-44640111c93f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.839964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.840863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.841156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.841437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.842816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:43.844370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d511fcb-e7b3-4ca2-a162-733d539240d8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:43.847268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 226/440] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:43.852552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dcdc3-ee5b-4671-82f8-31701feb7d67 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.852838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dcdc3-ee5b-4671-82f8-31701feb7d67 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.853131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dcdc3-ee5b-4671-82f8-31701feb7d67 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.854584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 227/441] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:43.856004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dcdc3-ee5b-4671-82f8-31701feb7d67 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:43.884121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:43.895074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b46ab-b620-45e4-9599-17c1774ba5d7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:43.938408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:43.939656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.940335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.940634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.955025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7a97ad77-737d-4543-9747-a7f0d58659ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:43.963665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:43.965128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:43.966345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 215/442] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:43.966985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:43.967299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:43.967390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:43.986613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:43.987843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:44.003101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.044785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dcdc3-ee5b-4671-82f8-31701feb7d67 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.075314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 216/443] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:44.076767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.088912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.090134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.090421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.090839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.091694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=74662fff99564ec2be1aacb12ca800b4) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:44.092026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.093491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.100969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 228/444] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:43 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=51263ee5485341fa98c78d57f2d235fb => generated 611 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:44.121730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.191748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.214005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a177d-0774-4620-8604-4ecd91b6391a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.261047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.262733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.263189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.263561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.264898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:44.265273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.266820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.277854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23322-d521-4f8a-b20d-1ce4dd561e0a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.278484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 217/445] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:44.284394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.342692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.343526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.343893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.344131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.362591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:44.381509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:44.383363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:54:44.384957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:44.387708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 229/446] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:44.394157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.398156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.439016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd379-d729-464f-a8eb-69dc933f338a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.482351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.483083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.483451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.483900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.502201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.522269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe131-2ba9-4970-87b1-db14f70816df None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.579088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.580049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.580508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.580962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.582274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:44.582768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.582972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.585168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.585362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.612121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 230/447] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:44.614546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.713531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.742308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 218/448] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:44.750064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.762940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11a8b-9571-4b91-8876-81c696345e4f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.810205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.811422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.811930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.812434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.814079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:44.877149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18c65-3740-43cb-bca0-61ed60169438 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:44.919906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.921385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.927867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:44.929118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:44.929512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:44.929950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] PATH_INFO: `/v3/projects/860ed82bdecd4cd588b102fbafc7b011` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:44.931895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=860ed82bdecd4cd588b102fbafc7b011)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:44.934121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:44.938050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 219/449] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/projects/860ed82bdecd4cd588b102fbafc7b011 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:44.945188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:44.997408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:45.046428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 231/450] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:45.052507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:45.067555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0617-3870-4003-ae53-497d675c7ba1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:45.082817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:45.104583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:45.106035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:45.106312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:45.106586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] PATH_INFO: `/v3/groups/3973c7b4ce63426684eb0d4af4d784b5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:45.107855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] RBAC: Authorizing `identity:get_group(group_id=3973c7b4ce63426684eb0d4af4d784b5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:45.109341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:45.111070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 220/451] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:44 2022] GET /identity/v3/groups/3973c7b4ce63426684eb0d4af4d784b5 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:45.117062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:45.223091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8f643-4109-4500-bd09-a25d44e3f5a0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:45.246653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab036a87-7cb3-47af-aa40-1ae1095809fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:45.274821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:45.275785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:45.276175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:45.276565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] PATH_INFO: `/v3/projects/74662fff99564ec2be1aacb12ca800b4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:45.279099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] RBAC: Authorizing `identity:get_project(project_id=74662fff99564ec2be1aacb12ca800b4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:45.281346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:45.283761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 232/452] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:54:45 2022] GET /identity/v3/projects/74662fff99564ec2be1aacb12ca800b4 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:45.289939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:45.294478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:45.295157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:45.295447 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:45.295728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:45.296582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] RBAC: Adding query filter params (group.id=3973c7b4ce63426684eb0d4af4d784b5, role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=860ed82bdecd4cd588b102fbafc7b011) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:45.296894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:45.298429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:45.305173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 221/453] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:45 2022] GET /identity/v3/role_assignments?group.id=3973c7b4ce63426684eb0d4af4d784b5&scope.project.id=860ed82bdecd4cd588b102fbafc7b011&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:45.342881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:45.426872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd088a1-b807-4bb3-8efa-cf2355a792da None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:45.473248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:45.474167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:45.474531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:45.474815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] PATH_INFO: `/v3/groups/f18120b80f924ee4aafb628837054048` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:45.476159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] RBAC: Authorizing `identity:get_group(group_id=f18120b80f924ee4aafb628837054048)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:45.477713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51baf7-650b-4145-b028-652495e6d2ca None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:45.480968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 233/454] 10.222.0.60 () {56 vars in 1180 bytes} [Mon Jul 11 13:54:45 2022] GET /identity/v3/groups/f18120b80f924ee4aafb628837054048 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:45.486230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:45.552653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:45.616695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa327-2057-49e8-9781-7c8e23789c13 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:45.655872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:45.656543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:45.656824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:45.657099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:45.657984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] RBAC: Adding query filter params (group.id=f18120b80f924ee4aafb628837054048, role.id=fb91a1eacf104c9ba3b62a4193b75e97, scope.project.id=74662fff99564ec2be1aacb12ca800b4) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:45.658291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:45.659783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393210f-f79a-4ac9-be71-99025b4dd5e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:45.666947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 222/455] 10.222.0.60 () {56 vars in 1376 bytes} [Mon Jul 11 13:54:45 2022] GET /identity/v3/role_assignments?group.id=f18120b80f924ee4aafb628837054048&scope.project.id=74662fff99564ec2be1aacb12ca800b4&role.id=fb91a1eacf104c9ba3b62a4193b75e97 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:49.423907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea9d7-bc0a-419c-ad30-f2e9ea493147 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:49.424969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea9d7-bc0a-419c-ad30-f2e9ea493147 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:49.425449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea9d7-bc0a-419c-ad30-f2e9ea493147 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:49.427475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 234/456] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:49.435681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:49.436637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:49.437144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:49.459694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50911f-1b09-44ff-9b92-6a5cd86e525d None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:49.459910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:49.460447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50911f-1b09-44ff-9b92-6a5cd86e525d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:49.460924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50911f-1b09-44ff-9b92-6a5cd86e525d None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:49.461040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:49.463050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 235/457] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:49.472075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:49.472707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:49.473189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:49.524506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:49.529595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:49.644172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 223/458] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:49.686493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:49.740131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 236/459] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:49.778622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:49.783231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:49.850409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:49.932484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d40a-8ccd-4941-9148-e37a4dd2cd75 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:49.945894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacb810-e089-4b88-aa27-dd136c519fd6 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:49.992478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:49.993852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:49.994537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:49.994981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:49.999008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.000395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.000982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.001471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.007591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.009300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.018064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.020120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ef3a02e9-1869-48f1-9bea-6593265d4f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:50.032901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:50.034897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 237/460] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f2d5-df97-472b-b632-4fa39abe82f8 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f2d5-df97-472b-b632-4fa39abe82f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.036518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f2d5-df97-472b-b632-4fa39abe82f8 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.041740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 238/461] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:50.051118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.051626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.051810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:50.059486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:50.061439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:50.062940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:50.062940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:50.062940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.062940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:50.065774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 224/462] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:50.066965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.090450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:50.093232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:50.181140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.194040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc9be-512a-4bf1-923b-adefbbf1df54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.220893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 239/463] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:50.222080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.242166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.273104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.274921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.275487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.276078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.277918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:50.278576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.280224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.302082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 225/464] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:50.303481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.356362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9e86-7eca-4ca6-a423-619b8b350761 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.405242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.406431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.406948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.407443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.408733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:50.409285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.411974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.434570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 240/465] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:50.435181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498706ac-1c95-4e40-b8ea-0d70003752cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.436448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.482225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.483011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.483418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.483541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.498334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.500940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3dd0138a-b62b-419f-a721-4b1c1628ff52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:50.519883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:50.520771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:50.522154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:50.522154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:50.522154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:50.522154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:50.522154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 226/466] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:50.522555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea80e-0314-4b1c-aec5-a0f2f2e837e4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.522765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea80e-0314-4b1c-aec5-a0f2f2e837e4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.523044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea80e-0314-4b1c-aec5-a0f2f2e837e4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.524510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 227/467] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:50.525109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ea80e-0314-4b1c-aec5-a0f2f2e837e4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.531057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.546340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.574226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185dc5-05b7-4eba-9b6c-3d105c171d1a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.615742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.616439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.616712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.616991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.617737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.619670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.648185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ea80e-0314-4b1c-aec5-a0f2f2e837e4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.687943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.688617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.688896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.689166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.689907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.691358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e39c1-f170-4893-be96-b3db48970cad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.740916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 241/468] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:50.741834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.841621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 228/469] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/users => generated 246 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:50.841621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1c55-a3b2-48a7-a3e4-4b3313834985 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.841621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1c55-a3b2-48a7-a3e4-4b3313834985 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.841621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1c55-a3b2-48a7-a3e4-4b3313834985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.857124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-895c1c55-a3b2-48a7-a3e4-4b3313834985 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:50.858615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-895c1c55-a3b2-48a7-a3e4-4b3313834985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:50.908754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d93f-704b-4c65-993e-0375c8f0b4f1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:50.954368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.957085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:50.962054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:50.962858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.963152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.963432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.966244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:50.966244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:50.966551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:50.978556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 229/470] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:50.980422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a936-0148-4f6e-934f-c87a80b0b535 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:50.980831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a936-0148-4f6e-934f-c87a80b0b535 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:50.980985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a936-0148-4f6e-934f-c87a80b0b535 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:50.985746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 242/471] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:50.990291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:50.991172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 230/472] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:50.997890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.000787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.000787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.024586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:51.026605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:51.137934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 231/473] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:51.138848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:51.147705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a49e4-b12d-4ab1-afd4-e7f6bc3e7400 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.211477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:51.213103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.213653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.215680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.217068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:51.220769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:51.301861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d747a-68af-4e02-a0d9-5f2dd7b57c74 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.331734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:51.362026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:51.362843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.363128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.363410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.375699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:51.378063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:51.392736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 243/474] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:50 2022] POST /identity/v3/users => generated 249 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:51.394221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:51.411849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:51.412819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:51.413766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:51.413766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:51.413766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:51.413766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:51.414676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 232/475] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:51.422034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:51.504785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:51.591217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2198ed-e13e-480d-b2a7-ca5d0af38e92 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.633709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:51.634480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.634766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.635039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.636745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:51.641618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:51.676843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da560-935a-406b-b97b-0a3305749de8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.680081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.sql.core [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:54:51.680081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 13:54:51.680081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [parameters: {'id': 'd6a6e76286ae49a6bc4de27d20739924', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 13:54:51.680081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application result.read() Jul 11 13:54:51.701260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:54:51.702348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application yield resource Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise self.value Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application session.commit() Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 13:54:51.703442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self.session.flush() Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application compat.raise_( Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 13:54:51.704481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:54:51.705630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application result.read() Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:54:51.706628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [parameters: {'id': 'd6a6e76286ae49a6bc4de27d20739924', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:51.707813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 13:54:51.708844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.711969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 244/476] 10.222.0.60 () {60 vars in 1131 bytes} [Mon Jul 11 13:54:51 2022] POST /identity/v3/roles => generated 144 bytes in 318 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:51.718849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:51.762330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:51.763632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.764337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.765017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.766670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:51.768111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:51.770306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:51.796525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 233/477] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:51.812107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:51.862128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:51.865546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240529a-6a1c-4bea-9974-f569202d1b5e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.882528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:51.930315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:51.931817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:51.932337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:51.932885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:51.953950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8af3-652e-4822-bb5e-c0962095214a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:51.959082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:51.976165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:51.977117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:54:51.977963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:51.979164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 245/478] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:54:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:51.988359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:52.011159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:52.011630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:52.011871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:52.012126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:52.017617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:52.017617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad235a-d39c-404b-8d84-8747367594bd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:52.118173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 234/479] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:51 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:54:52.161254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff0580-8b70-46b0-ae58-a132985c60d7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:52.232002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:52.233174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:52.233762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:52.234267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:52.235679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:52.236075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:52.238297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4ff72-6f0f-4839-b6b8-2409132309d4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:52.254965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 246/480] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:53.466432 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbff0-f34c-429f-a795-62f081ab2d7d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:53.467328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbff0-f34c-429f-a795-62f081ab2d7d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:53.467328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbff0-f34c-429f-a795-62f081ab2d7d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:53.468769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 235/481] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:53.474846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:53.475604 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:53.475604 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:53.495923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:53.497565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:53.504423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710607bc-d85e-45e2-a58d-4da117b03c52 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:53.504817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710607bc-d85e-45e2-a58d-4da117b03c52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:53.504965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710607bc-d85e-45e2-a58d-4da117b03c52 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:53.506735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 236/482] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:53.514597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:53.515015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:53.515160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:53.544938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:53.546209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:53.577116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:53.718488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 247/483] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:53.745759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:53.770030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 237/484] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:54:53.822686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:53.858261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:53.938589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f44964-ec0c-433f-9b5e-2b663e4e09d1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.031372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ce82a-b266-439f-8a6b-ef210287ace8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.034816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.036324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.036826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.037323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.074797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:54.083108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:54.084875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:54.086441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 248/485] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:54.094681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:54.122758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.123574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.123909 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.124200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.147223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:54.156010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:54.164817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:54.170421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:54.172009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 238/486] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:54.174478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:54.313822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca92c1-4ebc-4ee2-92ee-813469a795c8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.315488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:54.376861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf863-fe54-40c4-993a-295b5d405532 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.418705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.419421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.419853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.420145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.420942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:54.421283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:54.422798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:54.440219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 249/487] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:54.446418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:54.467865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.468676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.468809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.470479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.470479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:54.470479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:54.471672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:54.487549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 239/488] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:54.493744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:54.631574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:54.676641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824f170-a8d9-495b-813f-b9d4d7e490e8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.740651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac070f-8ce2-406e-ad45-418b123e1055 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:54.753214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.754698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.755208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.755700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.779333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:54.782316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:54.819133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:54.820790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:54.822520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:54.822520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:54.822520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:54.822520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:54.822520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 250/489] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:54:54.832472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:54.843370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:54.844214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:54.849741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:54.850151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:54.861169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:54.873973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:54.877616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:54.916577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:54.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:54.923884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:54.923884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:54.923884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:54.923884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:54.923884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 240/490] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:54.924726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.052518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80306ba4-1baa-4021-89de-e6f8588c8ecb None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.110264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdac17-27ef-4361-a33e-052ca73f496f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.123482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.124655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.125169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.125725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.127130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:55.127673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.131148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815928b-ee60-452f-80a6-7fbc722625c6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.136464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:55.155701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.156751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.157233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.157747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.158694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:55.159217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.164297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 251/491] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:54:55.164297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89829cdd-a6a8-4e79-ba1a-d67b6a50b7f8 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.164297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89829cdd-a6a8-4e79-ba1a-d67b6a50b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.164297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89829cdd-a6a8-4e79-ba1a-d67b6a50b7f8 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.165937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4019c-ba80-41e7-9866-4e922fe15d81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.166335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 252/492] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:55.169081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89829cdd-a6a8-4e79-ba1a-d67b6a50b7f8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.183332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 241/493] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:55.185523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.186194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.186668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.207616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:55.209270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:55.293990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:55.323420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 242/494] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:55.324507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.387835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89829cdd-a6a8-4e79-ba1a-d67b6a50b7f8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.453126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.453878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.454161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.454514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.464866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.466432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:54:55.485851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:55.487531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 253/495] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:55.489403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.525986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6fc0-e8e1-46d8-b142-f3e750ea9ee0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.565674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:55.572849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.574651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.580054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.580054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.584383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.586257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4bec9a3e-1674-4e32-9c7c-76f72ea589b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:54:55.604690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:55.605892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:55.606770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 243/496] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:55.607942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ebf1-b36b-41d2-bedf-fcd96c586b85 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.608861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ebf1-b36b-41d2-bedf-fcd96c586b85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.608861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ebf1-b36b-41d2-bedf-fcd96c586b85 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.609945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 244/497] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:55.614900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1ebf1-b36b-41d2-bedf-fcd96c586b85 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.653614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfdef9-e0e5-4135-888e-b16863ca104c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.687549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:55.705188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.705995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.706283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.706582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.721743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:55.731663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:55.733716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:55.735281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 254/498] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:55.736551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:55.793171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1ebf1-b36b-41d2-bedf-fcd96c586b85 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.855010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.856177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.856657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.857134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.858532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:55.859030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.861426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181bb67-c0b2-4d96-8c7a-2291e9b644f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.874025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae18b6-72c0-468e-b927-eca7f256ec64 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:55.892940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:55.913406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:55.914113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.914398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.914674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.915518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:55.915827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:55.918541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8729-b33e-4e6d-a194-8cd43812a742 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:55.936727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 245/499] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:55.936727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.936727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.936727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.964651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:55.966487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:55.972393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 255/500] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:55.973856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8e92-3bfd-4075-bc10-2bae700bf4c3 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:55.974155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8e92-3bfd-4075-bc10-2bae700bf4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:55.974409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8e92-3bfd-4075-bc10-2bae700bf4c3 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:55.977627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 256/501] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:54:55.977627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8e92-3bfd-4075-bc10-2bae700bf4c3 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.077400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 246/502] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:56.078329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.112834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.124922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8e92-3bfd-4075-bc10-2bae700bf4c3 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:56.165415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:56.166139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.166420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.166708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.168006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:56.168476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:56.169942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:56.179499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 257/503] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:56.180130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.209401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed74c0-0cf2-4234-aa19-5c971c2bea65 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:56.238203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.255012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:56.255874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.256240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.256653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.337428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93193-7dbf-4cdc-8637-0620e07d2b20 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:56.342524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:56.344033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cd413-9630-46da-9ff0-1a754b714973 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:56.377870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.405803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:56.406914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.407426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.407940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.477672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 247/504] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:56.479033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4606-480c-400d-a627-06644cc032d3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.479486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4606-480c-400d-a627-06644cc032d3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.480213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4606-480c-400d-a627-06644cc032d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.500395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-231b4606-480c-400d-a627-06644cc032d3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:54:56.502219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-231b4606-480c-400d-a627-06644cc032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:54:56.505136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:56.507429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:56.563416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.602086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 248/505] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:54:56.603565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4606-480c-400d-a627-06644cc032d3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.676816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 258/506] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:56.678110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.701296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.759404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4606-480c-400d-a627-06644cc032d3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:56.814351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:56.815613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.816063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.816476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.827193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331dd43-cc61-488b-9b5b-e5b15bca8402 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:56.830231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:54:56.838593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:56.840599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:56.842151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 249/507] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:56.844319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:56.875565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:56.876485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:56.876846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:56.877251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:56.881459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:56.892301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:56.893991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:56.920248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:56.929851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 259/508] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:56.931513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.006877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1bdb-34f3-4975-9259-1a4b184f49f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.033681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.055336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.056224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.056571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.056906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.070145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.071737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.072812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7743d0-f80b-4e0a-91f0-772ad99bbc5b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:57.093365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:57.094713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:57.095884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:57.095884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:57.095884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.095884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:57.095884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 250/509] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:57.096945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.123716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.124666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.125049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.125466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.139947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.141726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:57.164030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:57.165946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 260/510] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:57.168055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.241276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.246311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376cc0-fb1f-4831-b278-f7e29c81e726 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.305241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.306481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.306932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.307340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.326811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.329296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.343982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1721d-0162-4579-b297-db77e7e7fb60 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:57.360292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:57.361235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:57.362149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:57.362149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:57.362149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:57.362149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:57.362370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 251/511] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:57.363706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.404354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.405434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.405908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.406355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.407637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:57.408163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.408452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.410264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.420476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 261/512] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:57.421095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.523613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d318dbc-cc45-4290-a000-b47d7fffe40e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.559103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644556d-c461-4d06-8a0d-2bf8f4503ff5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.561966 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.565291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.566408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.566868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.567329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.568584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:57.569096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.571674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.591972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 252/513] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:57.592942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.606979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.607672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.607953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.608228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.608968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:57.609302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.610886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.626443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 262/514] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:57.627476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.707815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.731943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940d76-e2a3-4f72-b7d2-8102f19ebee4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.765828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ac5e-e4f3-4d9b-a47a-99f09a3796a8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.781616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.782435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.782805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.783198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.784173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:57.784659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.786410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.802630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 253/515] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:57.804217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.818518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:57.819458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:57.819952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:57.820453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:57.821767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:57.822299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:57.825770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:57.846651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 263/516] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:57.848076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:57.880588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:57.966058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caccfad-ab1a-4ff1-8c2f-2eeb8b0be437 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:57.978394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86437148-5413-454f-833f-c5cef0c5fdf6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.008789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.009816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.010205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.011089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.024296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.025113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.025326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.025516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.025729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.030744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.033187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:58.035259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.036736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:54:58.052169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:58.053923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:58.056179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:54:58.056179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:54:58.056179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:54:58.056179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:54:58.056706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:58.059167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:54:58.061414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:54:58.062595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 254/517] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:58.062595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.062841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 264/518] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:54:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:58.062841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.174296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:58.195240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5bff-067f-463b-9efd-6844daa254ea None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.199100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4b869-e212-400a-8a5f-89a6534d1c00 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.237316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.238031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.238313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.238587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.239297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.239408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.240235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.240510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.240764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.240866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.249189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.250712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:54:58.267719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:58.269077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 255/519] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:58.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.336824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:58.347051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 265/520] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:54:58 2022] POST /identity/v3/users => generated 247 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:54:58.348331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.432462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88539-5de5-452f-94a3-eeafa73bb4df None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.483874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.485098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.485561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.486118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.497268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.500019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.524645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2203f8-6be3-4fff-8928-63593d4a600f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:54:58.527697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:58.528605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:54:58.529523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:58.535219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 256/521] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:58.535219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.587680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.588827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.589302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.589863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.591417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:58.591932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.595464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.615533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:58.630262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 266/522] 10.222.0.60 () {56 vars in 1139 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:58.632374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.692421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c9fcd-f2b4-46ba-be8e-dc046e6e677e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.711356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:58.739865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.740549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.740834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.741114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.741893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:58.742203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.743756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.758703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 257/523] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:58.759619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.840963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c01c-9bd7-4464-9224-469a1618463b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.902792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.903870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.904599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:58.905071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:58.906289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:58.906712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:58.909073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:58.923936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5a670-cf15-4663-88fa-73cedd8afbf6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:58.940818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 267/524] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:58.940818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:58.998144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:58.999377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:58.999878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.000363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.002025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:59.002688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.005534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.007166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:59.042226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 258/525] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:59.042226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:59.088624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f953ab-e8b3-4027-a53f-9b780627545e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:59.100454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:59.163416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:59.164587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:59.165068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.165562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.203292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1612-27e0-40d5-a8fa-21be06e0b33f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:59.273432 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:59.273716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.275031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.275351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:59.275836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.276889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.291068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.294445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:54:59.323257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:54:59.325271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 259/526] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:54:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:54:59.327633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:59.403209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:59.470742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 268/527] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:54:59.472320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:59.488104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:59.498773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cccfb-3c56-45d6-b94a-e93904790a55 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:59.558514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:59.559612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:59.560056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.560501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.561786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:59.562299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.564773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.575753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 260/528] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:59 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:59.587205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:59.688622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04f8a-1f09-4296-909a-41036ec48512 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:59.771521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:59.772211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:59.772483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.772771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.773695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=8f04bae4e4cd42b48ff4b6f351fa1bcc) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:59.774042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.775538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.785295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 269/529] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:54:59 2022] GET /identity/v3/role_assignments?user.id=8f04bae4e4cd42b48ff4b6f351fa1bcc&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:54:59.786254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:54:59.810142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b1280-e41c-405e-add0-4acd1d52dc80 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:54:59.826508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:54:59.912306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:54:59.913506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:54:59.914029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:54:59.914512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:54:59.916216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:54:59.916793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:54:59.919655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:54:59.997397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 261/530] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:54:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:00.004130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.026311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b412021-d04b-4809-8aa5-3211b3c7e9fa None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.045336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:00.134936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.138779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.139314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.139811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.144162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7553aae-eb96-4036-8c7c-b72b63a8e4fc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.167753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.169721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.192053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.192737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.193023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.193301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:00.211516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:00.212434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:00.213277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:00.213277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:00.213277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:00.213277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:00.213277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 270/531] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:00.222423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.315919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.317652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.339264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:00.374229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:00.445495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 262/532] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:00.446436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.505792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6d04b-3172-411f-b2c2-5438752894af None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.565549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffbc2-b2cb-476d-91eb-f94b0e284522 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.607037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:00.614409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.616355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.617079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.617538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.629040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.630427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.630655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.631736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.632714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:00.633210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.634962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.648008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.651318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.652602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 271/533] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:00.661741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:00.703339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:00.704228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:00.705148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:00.705148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:00.705148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:00.705148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:00.710857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 263/534] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:00.712885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.829690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cf51-f90d-421d-9c8b-823b55ac972c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.871001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.872304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:00.872938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.873473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.873997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.878784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf52a2-f2bd-4a9e-98d3-587f68047f27 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:00.884207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.886100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:00.904546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:00.905452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:00.906811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:00.909668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 272/535] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:00.918600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:00.974544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:00.975573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:00.976084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:00.976561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:00.977713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:00.978287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:00.980836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598868f-6314-488c-93c9-18725b22eccb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:00.998863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 264/536] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:01.000692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c5c62-c27a-477c-b2cd-1c95d74b9985 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.001246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c5c62-c27a-477c-b2cd-1c95d74b9985 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.001802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c5c62-c27a-477c-b2cd-1c95d74b9985 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.004012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 265/537] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:01.005099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c5c62-c27a-477c-b2cd-1c95d74b9985 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:01.053991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:01.082810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d772a0-7b31-4b6a-a7f2-da2c7596a000 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:01.128218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:01.128898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.129249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.129572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.130499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:01.130889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:01.132309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca525136-881b-49d6-822e-173a521caf1a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:01.153626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 273/538] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:01.153626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.154055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.154055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.187767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:01.189025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:01.238562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c5c62-c27a-477c-b2cd-1c95d74b9985 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:01.291033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:01.316057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:01.318541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.319377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.320062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.334111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 274/539] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:01.334832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:01.335844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:01.337985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:01.369173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:01.371832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:01.373484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:01.378570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 266/540] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:01.391253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:01.567741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:01.568042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccea934-2d24-475c-a6ad-1bc8188d2243 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:01.591611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284c17-b153-49bb-bcba-509559f8da8d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:01.639100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:01.640285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.640837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.641439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.643248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=2be8d3204196494f9acc8cdf258c2458) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:01.643871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:01.646835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:01.665614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:01.665950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 275/541] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:01 2022] GET /identity/v3/role_assignments?user.id=2be8d3204196494f9acc8cdf258c2458&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:01.665950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:01.668395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.669140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.669879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.671562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:01.672313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:01.675206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:01.715410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 267/542] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:01.734808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:01.764835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:01.878002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc10f78-f059-4ea7-bb3f-d07f2a6dc39b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:01.954671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:01.956508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:01.957274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:01.958015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:01.978939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:01.995119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:01.996774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:01.998338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:02.003083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 276/543] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:02.013481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:02.035940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87997078-ae0f-4563-9381-8c93f9f9c6c7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:02.119702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:02.120780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:02.121260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:02.121799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:02.123562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=88ad61a2fb834e31b4a6f6df2f023e1a) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:02.123957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:02.126722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:02.138670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 268/544] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:01 2022] GET /identity/v3/role_assignments?user.id=88ad61a2fb834e31b4a6f6df2f023e1a&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:02.254370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304193a-5e2a-4a4b-89d7-10e3de5b48f7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:02.270258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:02.347086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:02.348295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:02.348816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:02.349337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:02.350970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:02.351548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:02.354880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435be4f2-2922-4945-a60e-48a67dd0c2f1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:02.379533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 277/545] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:02.388971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:02.430273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:02.657316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ba5d-0da3-4c39-b62a-a32ce5025f55 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:02.746728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:02.748149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:02.748668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:02.749182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:02.778012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:02.780687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa54e1-14a6-4b0f-b79e-79ab326638a4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:02.780904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:02.781341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa54e1-14a6-4b0f-b79e-79ab326638a4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:02.781823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa54e1-14a6-4b0f-b79e-79ab326638a4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:02.783690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 278/546] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:02.795154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd003bd-66bd-4b5a-9c87-ffa38789f338 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:02.795705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd003bd-66bd-4b5a-9c87-ffa38789f338 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:02.796151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd003bd-66bd-4b5a-9c87-ffa38789f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:02.845137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:02.847925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:02.850669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:02.850669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:02.850669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:02.850669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:02.851790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5cd003bd-66bd-4b5a-9c87-ffa38789f338 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:02.851790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5cd003bd-66bd-4b5a-9c87-ffa38789f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:02.855690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 269/547] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 468 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:02.863067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.028202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:03.039770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 279/548] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:55:03.042197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a34a6-e326-4fe9-9db0-e013810b1261 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.042792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a34a6-e326-4fe9-9db0-e013810b1261 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.043264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a34a6-e326-4fe9-9db0-e013810b1261 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.049191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 280/549] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:03.051702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.052447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.053158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.076022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307a76a-dc8f-4aa1-b5dd-93beda5a5ec5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.082328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:03.084767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:03.124741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.125427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.125764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.126047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.126800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:03.127102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:03.128518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:03.148061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 270/550] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:03.148061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.218520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 281/551] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:03.220532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.272287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:03.294886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423f38-3b4f-452b-a727-db3f75d8a33f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.330665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:03.345441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.346318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.346625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.346943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.361065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:03.371692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:03.375671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 271/552] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:03.377319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.393731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328174-ce48-421b-a96e-7381812952d7 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.475716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.477806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.478705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.479513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.494416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:03.498208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:03.527652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:03.529474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:03.531902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:03.536334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 282/553] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:03.538275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.614825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db13d5-d249-4faa-8deb-c563b6e6dae9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.679117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.680419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.680895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.681366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.702075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:03.715108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:03.717175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:03.718973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:03.720541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:03.725768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 272/554] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:03.731390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.746741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6a6a-8328-4ad5-9908-947efcf592ed None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.807127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:03.837099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.840144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.840800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.841431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.843161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:03.844010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:03.847951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:03.870628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 283/555] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:03.873342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:03.878337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d9643-c33e-4640-9a80-efd2fd6298a3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:03.930922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:03.931964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:03.932438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:03.932893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:03.934019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:03.934520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:03.936222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:03.956332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 273/556] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:03.957494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.047978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd433ca9-f60b-45e1-8f21-c351009591b0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.080180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416722d8-879a-4ded-9791-eb1f887f6fcf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.082707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.088103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.092360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.092360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.092360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.092360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:04.092360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.092702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.102205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 284/557] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:04.102865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.124219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.125357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.125865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.126333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.127787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.138942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.144120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:04.161766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:04.163211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:04.164072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:04.164072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:04.164072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:04.164072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:04.166375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 274/558] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:04.168149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.234333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19eeeb-7cf4-4b23-92ac-4752e8ccd50e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.287323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.292191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.292191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.293321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.295112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be80f5-260f-4341-ac61-161f360f3ca1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.342386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.343307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.343602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.343999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.359671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.361528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:04.384091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:04.388385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 275/559] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:04.390141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.402218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.479701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.484095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.513045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.531180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa599d-64b1-476e-8931-feab71e46609 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.589350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.590440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.591219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.591687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.592705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:04.593196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.595640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.614162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 276/560] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:04.615465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.684886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 285/561] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:04.686576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.707014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.756131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2669-a2b0-4e7a-b31f-26e34f9c1835 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.815625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.818259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.819008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.819592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.820600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:04.821198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.824204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.840338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 277/562] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:04.841297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.863385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621e68-92ce-40ff-970f-edbf6bb9e613 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:04.884861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:04.909250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:04.910098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.910380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.910655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.919014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:04.920566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-92d856f3-d5fa-497d-8843-8370643a8f84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:04.937396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:04.938440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:04.939430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 286/563] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:04.940840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d7c-10c6-48fb-af8a-d2d8180e196f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:04.940840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d7c-10c6-48fb-af8a-d2d8180e196f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:04.940840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d7c-10c6-48fb-af8a-d2d8180e196f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:04.942311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 287/564] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:04.942879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27d7c-10c6-48fb-af8a-d2d8180e196f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:04.974100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95635e-50cb-4ec6-8197-a1e92ce42b9e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.010841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.021689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.022602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.024119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.024290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.035841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.037329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b201f8f0-374e-4764-9fbc-b0df8d150f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:05.056270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:05.063243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 278/565] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3716a-e8a8-4171-b226-f5bf4d4011bc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3716a-e8a8-4171-b226-f5bf4d4011bc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3716a-e8a8-4171-b226-f5bf4d4011bc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.064162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 279/566] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:05.064688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3716a-e8a8-4171-b226-f5bf4d4011bc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.075352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27d7c-10c6-48fb-af8a-d2d8180e196f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.113386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.114251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.114539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.114816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.124571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.126105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ae7bb08a-7330-4db1-8ed9-f11cd544ae8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:05.142561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:05.143691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:05.144838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 288/567] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:55:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:05.145486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.145797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.146043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.164989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:05.166793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:05.192549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3716a-e8a8-4171-b226-f5bf4d4011bc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.195453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.238158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.238884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.239169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.239444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.250232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 289/568] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:05.250509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:05.250509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.250782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.250917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8a129-7b6b-4760-84df-caea9d5e6737 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.281167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 280/569] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:05.282825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.283122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.283405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.303712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:05.309211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:05.343201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.381872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e27cf-e3dd-45da-83c9-a208fdb29998 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.389913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 281/570] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:05.390774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.423852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.424543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.424828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.425105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.425888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:05.426198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.427614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.442781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 290/571] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:05.443563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.472653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.557529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbb9c5-3a3d-422d-8db9-35a2dd96d1f9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.567267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a054593-e9cc-49db-b165-77dd9f5cbb21 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.612827 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.614062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.614559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.615044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.616724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:05.617279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.618487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.620085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.620367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.620651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.621032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.634199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:05.643081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:05.649989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 291/572] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:05.651151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.657505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 282/573] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:05.658983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.704647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.762266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:05.786031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747d1e-d6cf-4bff-85c6-0552885ef6a3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.803893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ee33c-7ccf-4948-9d98-06969e6ca997 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:05.833968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.834901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.835254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.835708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.850775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:05.851403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:05.851795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:05.852158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:05.852529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:05.853268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:05.867177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:05.875860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:05.877849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:05.883418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:05.883418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:05.883418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:05.883418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:05.883844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:05.885895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:05.887403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 283/574] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:05.888737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 292/575] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:05.888869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.889005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:05.999836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.005844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92411-e158-49d6-992b-6157d8c36d9d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.026569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38944d-bef2-4b07-818c-81526bb286e9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.060021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.060733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.061050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.061329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.062328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.062827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.064501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.066205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.076116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 293/576] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:06.077006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.080338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.081119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.081497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.081747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.089944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.091426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:06.107655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:06.108850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 284/577] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:06.110174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.229460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063c4c4-5999-4400-9bde-5dc1d89b52ea None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.236321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041517-160d-420b-a097-faf589f58fc9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.277982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.278737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.279023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.279323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.282444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.283337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.283775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.284186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.285117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.285550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.287149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.292694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.294435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.305214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 285/578] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:06.305214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:06.315519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:06.317015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 294/579] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:06.318736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.319368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.382906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.452569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298f5e-d6fe-435d-aa57-5928ad21961f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.471956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccff26-8753-48cd-a1e7-1bde126bed5c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.498643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.499462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.499744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.500019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.512383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.513897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.528870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.529964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.530472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.530983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.532416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.532977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:06.534954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:06.536593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:06.539456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:06.539456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:06.539456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.539456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:06.540106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.541821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 295/580] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:06.541821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.558467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 286/581] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:06.559904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.664161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.665847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.669941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcc2e1-0c19-4285-b01b-7e3c7d462185 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.712201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.712874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.713212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.713489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.714341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.714654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.715475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b4c65-1641-4f28-95de-650497539e5b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.716265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.730159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 296/582] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:06.731057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.760943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.761807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.762087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.762365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.774048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.775614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:06.801219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:06.802322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:06.803225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:06.803225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:06.803225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:06.803225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:06.803225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 287/583] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:06.804516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.885912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c292a6-5bdc-47da-b84e-72324cdbfadd None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.931094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cbf7-4f03-4314-964a-ba7207fd1f0b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:06.932842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.933733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.934168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.934531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.935582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.936095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.937709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:06.953565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 297/584] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:06.954129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.954449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:06.982789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:06.983174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:06.983797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:06.984189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:06.984579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:06.985814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:06.986333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:06.988734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.008006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 288/585] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:07.008880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.101177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02c8c-ff97-4ea6-a752-5ee54679478f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.146190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.147006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.147287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.147564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.155958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.157425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.168107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7779d7-11b9-4c7b-9b05-4281c0b94c43 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:07.172526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:07.173986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 298/586] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:07.175505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.214469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.215756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.216211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.216664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.218160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=d459c85484c843f9ad25f90d76d0a634) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:07.218684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.221033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.241683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 289/587] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/role_assignments?user.id=d459c85484c843f9ad25f90d76d0a634&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:07.241683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.325189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:07.325553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:07.362964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e85d-9584-4c17-99f2-e6e34c24c150 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.422747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.423679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.423679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.423947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.424822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:07.425032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.426631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.436861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758640a3-3b43-468f-98af-b4fe4f58e2d4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.448894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 299/588] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:07.448894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.498261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.499070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.499360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.499637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.507897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.509392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:07.526367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:07.528247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:07.531143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:07.532740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 290/589] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:07.533806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.649444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c52ee-8bdb-406a-ad7a-561bd2f0cf90 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.703041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9374be-c098-4156-b8e6-f5ce7b5bd705 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:07.706643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:07.716779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.718186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.727615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.727615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.734833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.737686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.743391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:07.770500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:07.771514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:55:07.772431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:07.772972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 300/590] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:07.774377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.787265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:07.788416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:07.788920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:07.789417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:07.792144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:07.792144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:07.794751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:07.828485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 291/591] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:07.828485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:07.949649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ab5f-88a1-41fa-ba9c-6f8caa690c6e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.017609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.019040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.019516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.019967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.026642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb60e15-ecb7-4839-9dba-47519ef133e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.030379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.032329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:08.050948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:08.052842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:08.054765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 301/592] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:08.055885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.105064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.106546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.107231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.107892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.109204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:08.109711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.112247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.145074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 292/593] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:08.145074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.151534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:08.185408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:08.224361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120219-ded7-4c2b-9c6f-2bb51bd18c20 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.278505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.279249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.279537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.279818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.280694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:08.281008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.283395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.314041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 302/594] 10.222.0.60 () {56 vars in 1139 bytes} [Mon Jul 11 13:55:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:08.320837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.336388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889c25-7867-4f2e-982e-19a6c615ff07 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.390646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.392426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.392830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.393350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/8f04bae4e4cd42b48ff4b6f351fa1bcc/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.423055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=8f04bae4e4cd42b48ff4b6f351fa1bcc, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.425859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.464483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d2cb-36bf-4a9e-bea3-1e9278af900a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.488212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:08.511200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.511961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.512304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.512683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.513647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:08.514036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.515682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.534262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 293/595] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:08 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/8f04bae4e4cd42b48ff4b6f351fa1bcc/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:08.540003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.551795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 303/596] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:55:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:08.554901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.684098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:08.746936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65419a-21b7-4691-8d0f-3a152cc4864e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.824153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5ba7-3c65-454f-b4fd-678438c64a53 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:08.833167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.834749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.835213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.835685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.862373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=1e0aca394e4f40c38b3f2db655c462f8, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.864865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.889599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:08.890574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:08.890997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:08.894616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:08.911073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:08.912990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:08.937764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:08.946769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 304/597] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:08.948562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:08.983939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 294/598] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:08 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:08.997446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:09.002730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:09.209619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756581c-9abe-4ef1-9211-be069b501619 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:09.262278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:09.278732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:09.280700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.280700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.280700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.284313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:09.284951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:09.287736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:09.327055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de324f8-7471-4db1-8dc9-3c4bfc18aac5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:09.340297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 295/599] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:09.345252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:09.412501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:09.413852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.414400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.414710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.435716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:09.437264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:09.477209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:09.480644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:09.482884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:09.482884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:09.482884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:09.482884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:09.482884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 305/600] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 540 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:09.488319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:09.678274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db0e94-e79e-46fb-aeca-7c0a6cf25a00 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:09.758680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:09.766373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:09.767390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.767679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.767957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.778008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:09.779646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:09.798834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237e2f-3652-4255-852a-26268e2c5487 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-70dc1e60-b0fa-4b63-a7d0-4e428dc9ef45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:09.806198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:09.809994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 296/601] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2df-1f8b-4e56-856f-bd7c20d0dfd1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.815258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2df-1f8b-4e56-856f-bd7c20d0dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.817536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2df-1f8b-4e56-856f-bd7c20d0dfd1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.817536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 297/602] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:09.817536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b2df-1f8b-4e56-856f-bd7c20d0dfd1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:09.873404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:09.874275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.874550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.874821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.875569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:09.875878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:09.878110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74b61-d1d6-4031-b2cb-1a79689d5124 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:09.882856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:09.898324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 306/603] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:09.900162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:09.901192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:09.901938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:09.928867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:09.930154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:10.021626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b2df-1f8b-4e56-856f-bd7c20d0dfd1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.060354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 307/604] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:10.062392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.092750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.093429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.093818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.094066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.094882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:10.095192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:10.096759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:10.121616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 298/605] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:10.121616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.190050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:10.228522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6396c-0896-4085-ad12-7f566de04d4c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.252385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5971-7e7d-471a-9ee8-eed5b3c4151a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.255629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:10.272773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.273952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.274399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.274825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.284187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:10.286184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:10.294793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.295632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.295968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.296219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:10.305060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:10.306164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:10.308267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:10.309268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:10.311461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 308/606] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:10.312527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:10.318366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:10.319434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:10.320361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:10.325097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 299/607] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:10.326142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.442591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9400-f22f-42c4-9bec-42d056db9354 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.448938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31c278-e67d-4969-b44e-356e02e98905 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.480629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:10.487939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.489268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.489737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.490232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/2be8d3204196494f9acc8cdf258c2458/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.492390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.493091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.493691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.494715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.495462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:10.495878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:10.497391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:10.511417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=2be8d3204196494f9acc8cdf258c2458, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:10.512469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 300/608] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:10.513359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.513476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:10.542067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:10.627933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34097d4-8b97-428a-bd18-f3a91844a6f1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.657933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 309/609] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:10 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/2be8d3204196494f9acc8cdf258c2458/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:10.657933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.699434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.700054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.700333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.700647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:10.701426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:10.703221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:10.707783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:10.732187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 301/610] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:10.735734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:10.902087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80964e4-80a5-47db-971b-4713abe0ec1e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.932378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:10.959697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b440ae-0022-43a0-a0bc-34aa124022c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:10.971457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:10.972749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:10.973207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:10.973689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/88ad61a2fb834e31b4a6f6df2f023e1a/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.000005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=88ad61a2fb834e31b4a6f6df2f023e1a, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:11.001906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:11.016996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:11.028905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.028905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.028905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.034226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:11.036117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:11.057672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:11.070385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 302/611] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:11.071316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:11.102801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:10 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/88ad61a2fb834e31b4a6f6df2f023e1a/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:11.226561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b1229-1aa6-446e-834d-4ff79c1deea5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:11.270693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:11.271633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.272083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.272538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.273446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:11.273930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:11.276294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:11.279874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:11.293374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 303/613] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:11.299335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:11.338169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:11.473507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ad50a-4e3d-49ff-b5a9-97e11807f937 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:11.558792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:11.560319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.560838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.561355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.581789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:11.584796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-73ce7292-f987-4be7-b196-af92a4b52fe1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:11.628790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:11.630136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:11.632116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:11.639806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 311/614] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:11.645282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:11.743167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504d6-2e04-45c1-ab6a-659f5de3d5e3 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.743786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504d6-2e04-45c1-ab6a-659f5de3d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.744538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504d6-2e04-45c1-ab6a-659f5de3d5e3 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.750523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 312/615] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:55:11.752441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.752828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.753183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.774924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:11.776314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:11.817287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117654-138e-4419-86d7-4e20f82754d2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:11.877359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:11.879682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:11.880377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:11.881557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:11.882851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:11.884073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:11.888539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:11.896832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 313/616] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:11.922023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:11.935763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 304/617] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:11.938529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:11.961926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.063985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.116909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dcd56-cc6f-4030-85c7-2b85773a6dfe None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.147307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246b60f-3e45-4fce-83f2-dac6fd84fd7c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.194356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.195756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.196258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.196771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.240177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:12.251249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:12.252257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:12.253317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 314/618] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:12.261062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.264487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.265811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.266358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.266806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.286021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:12.287522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a649d4be-129f-4e91-82be-adf7cfa2e40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:12.313261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:12.321491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 305/619] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0717-c6a6-4a0a-8027-e69db8e8396a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0717-c6a6-4a0a-8027-e69db8e8396a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.322531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0717-c6a6-4a0a-8027-e69db8e8396a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.324560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 306/620] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:12.328255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd0717-c6a6-4a0a-8027-e69db8e8396a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.391996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.420304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78a845-244f-413e-a78c-513cb61cc133 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.472220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.472936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.473217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.473716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.474517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:12.474826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:12.476681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a80a0-1233-445f-9068-769c33c06312 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:12.496276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 315/621] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:12.496276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.496276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.496276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.505860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd0717-c6a6-4a0a-8027-e69db8e8396a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.516030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.516288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:12.518247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:12.550325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.551355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.551879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.552346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.553339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:12.553863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:12.555507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:12.571542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 307/622] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:12.572922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.599588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 316/623] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:12.600528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.680720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.697693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a902e-975e-4410-9585-12b344eddf9e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.715385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781e49-6e98-4be1-abfb-bb46f51274a2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.741171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.742742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.743548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.744069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.756414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:12.757404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:12.757794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:12.758077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:12.758318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:12.760995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:12.766841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:12.768379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:12.782190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:12.783136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:12.784023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:12.784023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:12.784023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:12.784023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:12.784805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:12.785993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 317/624] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:12.787598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.790991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 308/625] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:12.792231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:12.830728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:12.951927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26369e2-4aa6-4670-831e-c59975215a2f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:12.981414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85c81-ec23-4e66-ab28-e1f23629b642 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:13.003431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:13.008964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.009886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.010268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.010520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.026344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:13.037084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:13.039910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 318/626] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:13.042424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:13.096594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.097564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.098485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.101002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.102346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:13.102861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:13.106963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:13.143184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 309/627] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:13.144377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:13.318564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec721bb-9901-4da1-a408-491809617aa0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:13.328205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:13.389429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.390231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.390715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.391012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.391512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec180c-e475-4969-85b6-c535aae9b79d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:13.392016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:13.392333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:13.393807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:13.418079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 319/628] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:13.419491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:13.492357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.494724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.495436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.496121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.497329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:13.499757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:13.501041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:13.504025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:13.524602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 310/629] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:13.527789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:13.579520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe56d87-c248-49b9-b659-ac53d9e4f149 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:13.648415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.649376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.649787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.649950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/d459c85484c843f9ad25f90d76d0a634/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.686643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=d459c85484c843f9ad25f90d76d0a634, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:13.688161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:13.771084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5a5a4-acbe-43ed-b588-8285972118a0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:13.826514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 320/630] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:13 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/d459c85484c843f9ad25f90d76d0a634/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:13.827854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:13.872436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:13.874411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.875265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.876067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.907529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:13.913643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:13.927475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6b20c4e0-fe26-406b-a106-620d795db577 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:13.942758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:13.944969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:55:13.947629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:13.949442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 311/631] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:13.957564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af37c-c9c3-4b94-879d-81284b836657 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:13.957564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af37c-c9c3-4b94-879d-81284b836657 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:13.957564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af37c-c9c3-4b94-879d-81284b836657 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:13.957564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 312/632] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:13.959439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829af37c-c9c3-4b94-879d-81284b836657 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.004145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8398e-c77b-4724-a6f2-95477c12bd2a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.007462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:14.064910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.065811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.066093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.066372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.085829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:14.090240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:14.124342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829af37c-c9c3-4b94-879d-81284b836657 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-8ac3417d-15ec-42a3-bee5-84e0eec64721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:14.125493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:14.127654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 321/633] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6620-0063-4e17-89b6-bb8cea2a4d26 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6620-0063-4e17-89b6-bb8cea2a4d26 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.130490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6620-0063-4e17-89b6-bb8cea2a4d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.153427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-20fb6620-0063-4e17-89b6-bb8cea2a4d26 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:14.155841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-20fb6620-0063-4e17-89b6-bb8cea2a4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:14.178489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.179274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.179582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.179861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.180822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:14.181140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:14.183647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0afb-fa69-4f8b-ba32-fb4f079252be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:14.205187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 313/634] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:55:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:14.206426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7b54-89f8-4d44-8570-d607792695e5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.206724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7b54-89f8-4d44-8570-d607792695e5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.207007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7b54-89f8-4d44-8570-d607792695e5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.208623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 314/635] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:14.209113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da7b54-89f8-4d44-8570-d607792695e5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.255471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 322/636] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:14.256912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.257234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.257490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.289406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:14.291277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:14.320640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:14.382053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da7b54-89f8-4d44-8570-d607792695e5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.388829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 323/637] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:14.390870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.417857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:14.435431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.436106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.436390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.436670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.437402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:14.437743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:14.439242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:14.456890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 315/638] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:14.457624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.564522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9f42e-4fe2-4e51-9bd4-77eee9eddefa None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.619889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.621049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.621543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.622078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.626604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878227d-cacb-4577-837b-99d0a79ed3e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.649098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:14.672298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.673128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.673433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.673715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.688989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:14.696975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:14.698916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 316/639] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:14.700953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.724763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:14.726505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:14.748567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:14.836311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50930c2-170c-42a7-8b05-f3bcbc2d6952 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:14.879490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 324/640] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:14.880743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:14.905194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:14.906517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:14.907032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:14.907535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:14.927559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:14.944209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:14.945237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:14.946104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 317/641] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:14.948027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.018754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52972ad1-3237-4123-9a9f-414453a2b618 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.030681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.038730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.066097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.067134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.067553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.068030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.078889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.080670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:15.101050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:15.110396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 325/642] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:15.111744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.154495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11c67-3166-45eb-992f-c4dc70ec887b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.214087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.215160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.215646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.216134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.217572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:15.218236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.220920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.241537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 318/643] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:15.241537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.262712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5352153-b508-4adf-beed-ace52219cbf3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.306717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.307752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.308037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.308383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.321743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.324317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:15.350566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:15.351756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:15.353058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:15.353058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:15.353058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.353058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:15.361096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 326/644] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:15.361096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.383875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.387796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef27e2-cfc2-44c5-8359-dfef9473d16e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.407996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.439250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.439940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.440210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.440484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.441237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:15.441540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.442982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.459857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 319/645] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:15.459857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.535476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc642-82f4-4db3-a30c-57a6f7b78adb None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.588660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.589856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.590362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.590857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.592579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:15.593136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.595267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.596479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47e371-4645-43fb-85fd-7f856e77272a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.629740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 327/646] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:15.629740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.644980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.646152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.646512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.646788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.660331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.661801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:15.680281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:15.682604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 320/647] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:15.683927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.708549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.741993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:15.766701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83ed-9e3c-4754-ba2e-0174cc981445 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.822167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.823272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.823564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.823964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.824712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:15.825015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.826483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.841339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 328/648] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:15.842374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:15.854052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698ce7-33e1-4c29-9f28-e8338e979335 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:15.926140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:15.927914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:15.928156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:15.928679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:15.948485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:15.951199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:15.986361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:15.987332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:15.988221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:15.988221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:15.988221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:15.988221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:15.989073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 321/649] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:15.990653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.036210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c54077-51d3-42fe-834e-6051b88decb1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.097737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.098630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.099100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.099517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.105133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.126389 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.175921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405b756-fc14-4e3c-b932-9ef2dc98d406 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.214485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.216962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.237026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.238124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.238581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.238958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.240177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:16.240655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.243360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.260693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 322/650] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:16.262204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.363281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 329/651] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:16.364712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.418894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8ae1-7623-41fe-b737-37a95ff01216 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.440633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.463171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.476019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.477128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.477628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.478813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.488218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.490390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ce349e22-e9c5-4265-861d-1383f8bbf5de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:16.507955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:16.510071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:16.511952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 323/652] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:16.513096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d44d-cd73-427a-bbdc-3d59509c3186 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.513233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d44d-cd73-427a-bbdc-3d59509c3186 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.513539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d44d-cd73-427a-bbdc-3d59509c3186 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.517790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 324/653] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:16.520287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d44d-cd73-427a-bbdc-3d59509c3186 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.531084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a46e8-fc1a-4006-8437-fdfc1a8583be None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.574238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.574922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.575208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.575493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.576212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:16.576522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.577984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.591642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 330/654] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:16.592522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.662428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d44d-cd73-427a-bbdc-3d59509c3186 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.718701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.720035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.720511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.720983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.732046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.733353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e71fd-e390-41ed-97a7-937d70d45712 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.733606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.736249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:16.750054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:16.751329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 325/655] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:16.757487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.782546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.783852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.784352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.784992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.802808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.804480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.815784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a68c8921-f952-478e-85cd-e6542525bc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:16.828235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:16.843861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 331/656] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.845492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.860381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:16.861928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:16.892109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1819-c180-44c8-874d-cfda6f71e788 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:16.942725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:16.943501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:16.943865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:16.944223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:16.945245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:16.945783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:16.948281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:16.957782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 332/657] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:16.963227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:16.972442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 326/658] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:16.972442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.105184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.111825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea873bc-2d2a-451d-97dc-dd1c018150a6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.120826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.131070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2be30c-f76c-4db4-9029-9d12aa67fd1e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.148812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.149498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.151279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.151279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.151898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:17.152170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.153675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.173356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 327/659] 10.222.0.60 () {56 vars in 1139 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:17.174069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.198597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.199682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.200141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.200591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.215381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.217909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:17.236708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:17.238160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 333/660] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:17.239978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.317122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26277-2d97-421f-930c-8042074a532b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.366012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.366785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.367213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.367662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.369846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:17.370204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.371353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb03d2-1ea1-4f38-bc4d-d2366a42d2b6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.372082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.390574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 328/661] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:17.391449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.411222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.412164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.412606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.412606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.413365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=8f04bae4e4cd42b48ff4b6f351fa1bcc) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:17.413719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.415202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.420765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.422497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 334/662] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/role_assignments?user.id=8f04bae4e4cd42b48ff4b6f351fa1bcc&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:17.423345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.453858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.550027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca00f1-4c86-4afd-a25c-6ad551a84ca3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.597324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a8c2-ba74-40a0-ab28-207251d89c62 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.628386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.629201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.629478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.629806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.647029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:17.655900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.656559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.656841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.657115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:17.660067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:17.661207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:17.662271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:17.663040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 329/663] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:17.663826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.781680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.783644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.798406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.838128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:17.871433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff85b5-cbf0-49ef-a602-0bbba2837729 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:17.931816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 335/664] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:17.931816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:17.943488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:17.944362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:17.944782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:17.945136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:17.946494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:17.946900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:17.949013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:17.982769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 330/665] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:17.984596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.075406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89021b18-5796-41e7-b61d-96a74834a4e0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.091508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.127913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.128742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.129025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.130142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.139869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.141524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:18.157762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:18.159494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 336/666] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:18.161834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.183615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dd44-7cfa-48e7-9251-9fdde0fe7383 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.230056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.230755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.231032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.231321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.232065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:18.232362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.233839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.245170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 331/667] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:18.246118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.251820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.363586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffdea0-7821-4cf9-be3a-c46ea2308ee8 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.390467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cbd2c-c127-4e3c-a543-a92ed754a930 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.423488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.424886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.425401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.425906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.442681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.443788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.444276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.444777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.445075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.447847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:18.481808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:18.482789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:18.484038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:18.484038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:18.484038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:18.484038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:18.484038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 337/668] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:18.485256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.528955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.561426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.563556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.567537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.643170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671a5d3-4b07-474d-8eae-d3f58aa5783e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.689657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.690351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.690657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.690982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.691801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:18.692160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.693772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.702926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 332/669] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:18.706582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.713330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 338/670] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:18.714665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.845989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.851151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6947c-2ced-4b3c-a3c6-c0e996944f90 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.855124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:18.881468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b292b0d-5833-471e-854d-ba2b06773cc4 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:18.892533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.899053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.899053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.899053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.913080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.914630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:18.935257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:18.936991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 333/671] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:18.938826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:18.949814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:18.950510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:18.950781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:18.951060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:18.951793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:18.952101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:18.953494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:18.978111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 339/672] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:18.980323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.113094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1e90-357f-44ed-a831-d355d0a74bdd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.134509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607108-c4e2-43e9-9135-c9213af59ac3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.179358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.180676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.180868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.181768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.182223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.182320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.182596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.182931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.183831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:19.184205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.185763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.193255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 340/673] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:19.194168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.209630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.213070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.217251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:19.244022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:19.245183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:19.246187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:19.246187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:19.246187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:19.246187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:19.246187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 334/674] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:19.247169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.270890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:19.371709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a6e0-e59f-4b38-ae74-ad2076eabb05 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.442156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac69d-2c18-40a4-ada1-aa8942a90a70 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.446598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.448334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.448839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.449341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.450135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:19.450442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.451866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.470501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 341/675] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:19.475563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.503431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.504637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.505075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.505493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.516195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.517704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:19.533678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:19.535524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 335/676] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:19.537525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.632798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:19.682682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:19.723124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f21c-66ba-4b2a-b8ed-0c5929425a17 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.792032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.792721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.793002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.793314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.795169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:19.795169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.795912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.804996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583d43-014a-4354-8fd7-9c762b2271ef None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:19.830789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 342/677] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:19.831692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.880673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:19.882580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:19.883384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:19.884259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:19.899677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:19.906122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:19.934826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:19.935957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:19.937051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:19.941658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 336/678] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:19.943319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:19.982276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bc131-d72c-4c26-a00e-89452d8b64ab None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.036292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:20.053835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.055421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.056206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.056997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.058947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:20.059821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.063257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b988-6bc2-4c4d-9c9f-2c66ca8d86fc None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:20.100488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 343/679] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:20.100488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427fb36-f26f-4296-b4b4-11c53c5c6203 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.100488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427fb36-f26f-4296-b4b4-11c53c5c6203 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.100488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427fb36-f26f-4296-b4b4-11c53c5c6203 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.100488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 344/680] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:20.101194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427fb36-f26f-4296-b4b4-11c53c5c6203 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:20.136169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdc6f-e9f3-4dbf-a4ca-3e009da52c54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.175676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:20.188697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.189539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.189845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.191901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.199200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.200706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:20.225615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:20.227635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:20.232768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 337/681] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:20.234794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:20.289988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427fb36-f26f-4296-b4b4-11c53c5c6203 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.344845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.345537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.345853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.346130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.346998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:20.347307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.348776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113d1f8-f912-4793-b231-b6cb94d00b4d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:20.377904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 345/682] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:20.377904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.377904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.377904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.403394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:20.405320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:20.460290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59d3c-a77c-4570-8bd2-b57a6458f25d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.481541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:20.518351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.519212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.519484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.519920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.521328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=2be8d3204196494f9acc8cdf258c2458) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:20.521910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.524603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:20.530199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 346/683] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:20.533369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:20.538287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 338/684] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:20 2022] GET /identity/v3/role_assignments?user.id=2be8d3204196494f9acc8cdf258c2458&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:20.539730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:20.655210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:20.723997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509c55-0873-4a10-b934-58c86d1ba7a4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.769402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe956-f5a5-46d1-896b-87eb0307e61d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:20.778888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.779625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.779910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.780280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.781175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:20.781499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.783070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:20.804128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 347/685] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:20.805128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:20.855246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:20.856053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:20.856831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:20.857123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:20.871585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:20.980474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:20.982406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.003667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21abb-0e3f-4f1a-8db8-47b4e9cab11d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.057298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:21.058550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.059081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.059381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.072324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:21.073908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.084475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:21.093897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:21.101888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 348/686] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:21.103633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:21.202622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 339/687] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:21.204628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:21.205371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:21.224307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30b53-291e-489f-8bd5-61d4cf95aef3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.270089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:21.271170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.271643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.272105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.273227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=88ad61a2fb834e31b4a6f6df2f023e1a) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:21.273823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:21.276229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.289782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 349/688] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:21 2022] GET /identity/v3/role_assignments?user.id=88ad61a2fb834e31b4a6f6df2f023e1a&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:21.292326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:21.447257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e944e-e5ab-4377-bdc2-7a3a93270402 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.526293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:21.527483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.527993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.528492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.529957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:21.530500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:21.533174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.553452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 340/689] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:21.563559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:21.580354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1ca6-9d59-42ac-89b6-bca0e2cdf6ba None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.582975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:21.661538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:21.663055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.663579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.664101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.693033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:21.697393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.734517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451129c2-3d1a-4015-bc30-e216a7e81327 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:21.736790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:21.738763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:21.740517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:21.740517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:21.740517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:21.740517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:21.746326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 350/690] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:21.753845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:21.760821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:21.831190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:21.831894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.832378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.832528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.833169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:21.834687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742732b6-d3dd-452e-88de-fcf619606c52 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:21.923270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8491c6-346b-41de-8597-6716b8665099 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:21.941393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 341/691] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:55:21 2022] POST /identity/v3/users => generated 254 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:55:21.956560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2904-912e-42f9-841e-e5d78ff17bc1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.956805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2904-912e-42f9-841e-e5d78ff17bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.957105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2904-912e-42f9-841e-e5d78ff17bc1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.958870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 342/692] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:55:21.965309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:21.965768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:21.965949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:21.999709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:22.000404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:22.000686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:22.000960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:22.001745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:22.002061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:22.004790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:22.009748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:22.011408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:22.036877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 351/693] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:22.045869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:22.177850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:22.206404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:22.241000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 343/694] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:55:22.261042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:22.280400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda81f1-1d74-4b8a-9a6e-c3170e785e3c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:22.358860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:22.360287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:22.360820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:22.361568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:22.376319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:22.379226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:22.407348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:22.408307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:22.409184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 352/695] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:22.415034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:22.457649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340dda-c73f-43bd-9930-74a6fd181429 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:22.534451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:22.535639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:22.536088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:22.536539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:22.559400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:22.573305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f970c1f-6e40-4d14-ac20-ba9d4c570ea4 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:22.574119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:22.575018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:22.575863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:22.581731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 344/696] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:22.585928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:22.642126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:22.685755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:22.687005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:22.687522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:22.688030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:22.689619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:22.690200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:22.693050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:22.743178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 353/697] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:22.750174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:22.761607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:22.862781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6581e-c34d-4690-b6de-4648f310c796 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:22.949244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:22.949972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:22.950256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:22.950597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:22.951369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:22.951680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:22.953123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:22.983230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 345/698] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:22.989869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:23.101427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e07f0-635c-47f1-acbb-d32c1784b862 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:23.219804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a860b-76c4-4fe8-b79a-d74ad4070eb0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:23.254934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:23.256054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:23.256529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:23.256962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:23.258736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=d459c85484c843f9ad25f90d76d0a634) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:23.259786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:23.262783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:23.266313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:23.288223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 354/699] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/role_assignments?user.id=d459c85484c843f9ad25f90d76d0a634&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:23.308493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:23.309994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:23.310491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:23.310986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:23.336986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:23.340169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:23.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:23.393074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:23.394799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:23.394799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:23.394799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:23.394799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:23.394799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 346/700] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:23.401153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:23.532048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:23.643027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a8ac-9f83-4dc2-a54e-44d5b2335ed1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:23.692497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:23.693628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:23.694144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:23.694620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:23.695595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:23.696219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:23.698118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8253b1-0e03-4c8a-bb59-7b2587a0bcc7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:23.713326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 355/701] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:23.721609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:24.012293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59733a-821e-46c2-8c72-7b6272083897 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.012746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59733a-821e-46c2-8c72-7b6272083897 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.013148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59733a-821e-46c2-8c72-7b6272083897 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:24.015644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943491c9-a5b9-4a80-ae65-47b42dcd7429 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:24.016039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 356/702] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:24.024501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.025023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.025499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:24.065284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:24.066538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:24.105204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baec93-2f39-45b4-815f-95516204387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:24.107167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baec93-2f39-45b4-815f-95516204387d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.108188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baec93-2f39-45b4-815f-95516204387d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.108961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baec93-2f39-45b4-815f-95516204387d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:24.134053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baec93-2f39-45b4-815f-95516204387d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:24.137493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baec93-2f39-45b4-815f-95516204387d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-19baec93-2f39-45b4-815f-95516204387d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:24.173545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:24.175519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:24.177311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:24.184438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 347/703] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:55:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:24.194516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baec93-2f39-45b4-815f-95516204387d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:24.232035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 357/704] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:55:24.271174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:24.296980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:24.398163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:24.500337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baec93-2f39-45b4-815f-95516204387d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:24.574442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:24.575607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.576096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.576583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:24.581306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:24.582050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:24.584867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:24.635486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23008f39-6db5-46ed-9bd3-4a274efe2a81 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:24.658666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 348/705] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:55:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:24.669112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:24.777613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:24.779386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.780103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.780795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] PATH_INFO: `/v3/services/network` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:24.786589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:24.789621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:24.861413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:24.863674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:24.865511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 358/706] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:24 2022] GET /identity/v3/services/network => generated 88 bytes in 594 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:24.875353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:24.933225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421a95-cdb3-4e76-9084-90a3ee5fb138 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:24.935949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:24.974445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:24.975529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:24.976036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:24.976510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.058779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.060660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4bfa1-e0a9-487c-954c-4008da6eb306 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.120502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:25.127367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e713-e27c-47c0-85cf-f14a2217438e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:25.166672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:25.180026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 349/707] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:55:25.182328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e25e8-4aaa-4edc-8b64-b7c92042e8e4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.182835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e25e8-4aaa-4edc-8b64-b7c92042e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.183336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e25e8-4aaa-4edc-8b64-b7c92042e8e4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.185251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 350/708] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:25.190406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e25e8-4aaa-4edc-8b64-b7c92042e8e4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:25.197468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:25.198989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.199532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.200075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.201621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] RBAC: Adding query filter params (name=network) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:25.202145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.205555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41d2-7c8f-4bb9-8270-ef884fb73621 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.217372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 359/709] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:25.223077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.223704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.224181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.262786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:25.265116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:25.369237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e25e8-4aaa-4edc-8b64-b7c92042e8e4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:25.382281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 360/710] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:25.384004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:25.433221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:25.435114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.435937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.436692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.458433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.461180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:25.497482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:25.498504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:25.499394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:25.499394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:25.499394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:25.499394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:25.500487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 351/711] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:25.501755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:25.533355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:25.546428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59ae3-45ac-4119-b0de-769c17558823 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:25.575212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:25.614406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:25.615356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.615839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.616323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.617510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] RBAC: Adding query filter params (type=network) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:25.619101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.621297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24161ba-f641-40f2-9460-936d85897c2b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 361/712] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34299-f3bc-426c-aacf-61964b1f7523 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34299-f3bc-426c-aacf-61964b1f7523 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e34299-f3bc-426c-aacf-61964b1f7523 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 362/713] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:25.637041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e34299-f3bc-426c-aacf-61964b1f7523 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:25.677028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735af5e-d0fd-427f-98c0-2569446db338 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:25.771568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:25.773326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.773725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.774062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.776429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.778959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9233a8fa-df8e-42d0-9fb8-f4540a6a259d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:25.811469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:25.812555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:25.813430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:25.814322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 352/714] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:25.817502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.817853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.818334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.856502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:25.858703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:25.867206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e34299-f3bc-426c-aacf-61964b1f7523 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:25.944804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:25.946875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:25.947823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:25.948728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:25.950687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:25.951656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:25.955320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:25.960067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 353/715] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:25.961025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:25.984649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 363/716] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:25.994896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.004117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.046073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.083074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbd63b-bc74-474a-a10e-949ba50b6d89 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.125534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.126260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.126543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.126837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.127542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:26.127850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.129271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.139900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 354/717] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:26.140890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.219313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289cbcb-cdce-4205-9637-bc06a90cd665 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.253961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.257056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6303-9bdb-430c-80da-e73956d57ec3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.296716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.298727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.299532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.299692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.299822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.300158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.300910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.301743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.313453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:26.317984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.321171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:26.321568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:26.323589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 355/718] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:26.326290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:26.361237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:26.363153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:26.364899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:26.377949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 364/719] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:26.380325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.479420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8bc3-edb6-4d1d-bc25-29024a0ebca6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.518426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.519112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.519398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.519700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.520401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:26.520706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.522171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.532161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.537746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 356/720] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:26.538810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.579864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06caff8-067e-49b3-b3fe-efa79be9f5f5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.590894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.652612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.656009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.658122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.658502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.659274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:26.659589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.661208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff39926-8db2-4812-a266-4d7297cf418f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.678520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 365/721] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:26.680218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a0ee-d797-4acf-9d21-d7a0dc9b361f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.680565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a0ee-d797-4acf-9d21-d7a0dc9b361f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.680840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6a0ee-d797-4acf-9d21-d7a0dc9b361f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.683420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 366/722] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:26.684306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6a0ee-d797-4acf-9d21-d7a0dc9b361f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.733088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c58-d235-41d2-b4ea-e6031c6e5552 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.793690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.795467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.795934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.796407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.799878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:26.799878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.801146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb6057-0443-44ee-8375-660d540a9767 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.824517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 357/723] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:26.826099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.826395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.826682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.853469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:26.855962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:26.878202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6a0ee-d797-4acf-9d21-d7a0dc9b361f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:26.928017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:26.928840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:26.929126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:26.929406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:26.941068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:26.943757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:26.945746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:26.966311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:26.967516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:26.968394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:26.968394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:26.968394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:26.968394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:26.968394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 367/724] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:26.969171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:26.983833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 358/725] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:26.985534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:27.010760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:27.099256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71385f0e-2d23-43d8-a7f3-305975d84a0c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:27.141786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:27.142266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:27.142554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:27.142832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:27.143683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:27.144005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:27.145676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:27.154562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 368/726] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:27.155633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71848016-d901-492a-8a16-2fa1780b59aa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:27.156170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:27.234262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:27.234896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:27.235190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:27.235477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:27.236234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:27.236548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:27.238065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:27.261569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:27.270051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 359/727] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:27.278531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:27.323272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d705bf-48fb-4e59-ae73-a03563f14666 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:27.387074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:27.387906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:27.388192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:27.388463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:27.417613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:27.425938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:27.427618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:27.429150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 369/728] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:27.438793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:27.500359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:27.590785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef11a-0fb9-4e4a-8f5f-f40c812a7d46 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:27.708794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:27.709678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:27.709961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:27.710237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:27.724852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:27.728573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:27.764607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ee0a-a056-4325-8545-83673287f340 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:27.784303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:27.786119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:27.787854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:27.796552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 360/729] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:55:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:27.802621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:27.831411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:27.896421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:27.897500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:27.898062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:27.898568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:27.900250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:27.901781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:27.903755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:27.926992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 370/730] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:27.934072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.078497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2697dff-89ac-4f4e-afc4-9a2e1238907c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:28.160457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:28.161648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.162218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.162784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.164644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:28.165213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:28.167984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:28.182175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:28.185408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb5e27-df18-4e83-a2f4-4fea85775925 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:28.208842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 361/731] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:55:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:28.214895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.294041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:28.294910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.295196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.295473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.325613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:28.327142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:28.390602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:28.391528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:28.392443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:28.392443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:28.392443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:28.392443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:28.392683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519da7-d5fd-4c96-9cf0-c95fa8f56781 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:28.402240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 371/732] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:28.411100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.441442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:28.442156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.442438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.442716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.515905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:28.516904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:28.529782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:28.531305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc926fa2-0c4b-4d7e-8ef7-b97fa1a4e17b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:28.666984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 362/733] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:28.666984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdffe5-fe41-4a0b-9497-2d17e4f5fae9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.666984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdffe5-fe41-4a0b-9497-2d17e4f5fae9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.666984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdffe5-fe41-4a0b-9497-2d17e4f5fae9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.666984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 363/734] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:28.667897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdffe5-fe41-4a0b-9497-2d17e4f5fae9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.670115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f6c24-208f-46be-b4dc-fe54cc98713c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:28.734774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:28.735894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.736399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.736919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.738719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:28.739476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:28.741519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73c8f1-dd80-4689-9ad1-0585679ab708 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:28.764293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 372/735] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:28.766127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.766494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.766844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.795579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:28.796792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:28.799049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:28.810575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdffe5-fe41-4a0b-9497-2d17e4f5fae9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:28.855373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:28.856353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:28.856750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:28.857101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:28.870081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:28.871573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:28.893449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:28.895232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:28.897627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:28.897627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:28.897627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:28.897627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:28.900358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 364/736] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:28.901262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.953999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 373/737] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:28.955249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:28.996242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:29.171546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a210-b136-435a-8c9f-66264b0261b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:29.173785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cfe68-3d6c-4802-9ac1-95ebc8ad8bff None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:29.250319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:29.252044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:29.252773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:29.253450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:29.256782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:29.258411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:29.259528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:29.260118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:29.262255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:29.262821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:29.265829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:29.277100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:29.281489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:29.296791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 374/738] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:29.301328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:29.317515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:29.319446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:29.322844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:29.326115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 365/739] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:29.327866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:29.337769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:29.494123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:29.526622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96cf88-4126-4232-90c2-cfa9a91be335 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:29.583695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bb320-6983-4070-9e1a-6513c802e7dc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:29.594682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:29.595834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:29.596340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:29.596841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:29.598270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:29.600923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:29.660439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:29.661871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:29.662421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:29.662935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:29.677796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:29.680779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:29.702327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 375/740] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:55:29 2022] POST /identity/v3/services => generated 240 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:29.704353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:29.705031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:29.706957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:29.708218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 366/741] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:29.714682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:29.960872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:29.983138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321970d-03a0-4572-8567-93c4e54dacab None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.044060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542e044-c66c-4e3a-9c95-01c711d524e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.059957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:30.061072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.061525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.061929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.063202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:30.063718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:30.066071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f26900-c7cb-4dbd-a9c2-01c649153b0e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:30.072216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:30.100766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 376/742] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:30.103322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e38-c8ce-4ff1-8e5e-fd4d4272a82c None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.103818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e38-c8ce-4ff1-8e5e-fd4d4272a82c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.104321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e38-c8ce-4ff1-8e5e-fd4d4272a82c None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.106622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:30.107278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 377/743] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:30.107777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.108274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.108960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.109307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f010de-fd32-4bca-9795-6814c8fcfb23 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.111146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:30.111146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:30.114067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24802bd-a6a4-4788-b23c-d933e772334a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:30.115765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f010de-fd32-4bca-9795-6814c8fcfb23 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.116381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f010de-fd32-4bca-9795-6814c8fcfb23 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.121697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 378/744] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:30.121697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f010de-fd32-4bca-9795-6814c8fcfb23 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:30.142231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 367/745] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:30.145265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c90d4-d02a-4a54-a25d-38ba2faef380 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.145803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c90d4-d02a-4a54-a25d-38ba2faef380 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.146293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c90d4-d02a-4a54-a25d-38ba2faef380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.176291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f19c90d4-d02a-4a54-a25d-38ba2faef380 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:30.178400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f19c90d4-d02a-4a54-a25d-38ba2faef380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:30.309630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 368/746] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:30 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:30.309630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.309630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.309630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.327879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f010de-fd32-4bca-9795-6814c8fcfb23 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.337918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:30.340084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:30.382221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:30.383004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.383307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.383917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.416460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:30.440289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 369/747] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:30 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:55:30.441700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:30.484578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:30.494926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:30.497226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:30.600995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c62a1-399d-440f-bb17-6739e19b27e0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.651201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 379/748] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:30 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:55:30.653112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:30.660371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:30.661361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.661892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.662278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:30.663276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=a4467c612a534ae9871d4a6579e19bb0) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:30.663714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:30.666054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:30.682132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 370/749] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:30 2022] GET /identity/v3/role_assignments?user.id=a4467c612a534ae9871d4a6579e19bb0&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:30.682132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:30.810016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:30.876298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:30.893108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9505-d2a1-4ebb-9d8f-9a9d7aacddac None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.927476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff3bd-6985-46fb-aa3b-13de76b1c157 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:30.971027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:30.974564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:30.975504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:30.976322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:31.001381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:31.002725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:31.003309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:31.003908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:31.005361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:31.006520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:31.008043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:31.024878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:31.030395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:31.031939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 380/750] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:31.033918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:31.100493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 371/751] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:55:30 2022] POST /identity/v3/services => generated 251 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:31.102100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:31.280707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8e0f2-5f1e-4be9-b9db-9834ed512153 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:31.374385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90d8b-3a4b-41f4-aedc-f5cd0149afc5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:31.378210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:31.379689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:31.380202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:31.380705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:31.381945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:31.408929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:31.411720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:31.454457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:31.455598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:31.456480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:31.456480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:31.456480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:31.456480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:31.457646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 381/752] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:31.468340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:31.468576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:31.469398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:31.470212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:31.471196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:31.472635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:31.473217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:31.477982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:31.487435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:31.500841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 372/753] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:31.511283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:31.738573 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea95aa3-8825-4ff3-b529-70811ed1cfed None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:31.829702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:31.830833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:31.831320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:31.831789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:31.833062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:31.833619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:31.837269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:31.878968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 382/754] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:31.888344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:31.932025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cfa0a-a68d-40fc-8f69-d20b18be2d28 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:32.094467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:32.095853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.096144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:32.096338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.096657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.119993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fdbbe-4075-4afc-a1ca-b75386a3ab69 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:32.146752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:32.148429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:32.195275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:32.197301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:32.199072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:32.199072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:32.199072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:32.199072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:32.202963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 373/755] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 693 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:32.210897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:32.212063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.212429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.212598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:32.212899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.240033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:32.245465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:32.290553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:32.305121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:32.308047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:32.310422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 383/756] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:32.318307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:32.609082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b1c16-97c7-42ca-b121-2503cebc2808 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:32.629400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1379-3403-423f-ac2a-04c852d86048 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:32.664874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:32.682936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:32.684439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.685184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.686024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.687978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:32.688765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:32.691885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf9e08-efec-44bb-9423-563bc3a88343 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:32.720694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 384/757] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:32.723586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a3c3-b4d4-459f-af26-54d57c3354e9 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.724094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a3c3-b4d4-459f-af26-54d57c3354e9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.724597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a3c3-b4d4-459f-af26-54d57c3354e9 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.727806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 385/758] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:32.733748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a3c3-b4d4-459f-af26-54d57c3354e9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:32.747574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:32.749128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.749932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.751615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.753302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:32.754106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:32.758025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878aa3f-3e4e-4a98-8b12-3b59c59a3f11 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:32.790170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 374/759] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:32.792961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:32.793756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:32.794415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:32.823693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:32.826051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:32.953862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a3c3-b4d4-459f-af26-54d57c3354e9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:32.955662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 375/760] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:32.958009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:32.982302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:33.064954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:33.066551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.067323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.068064 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.069913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=d459c85484c843f9ad25f90d76d0a634) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:33.070787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:33.074250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:33.085303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 386/761] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:32 2022] GET /identity/v3/role_assignments?user.id=d459c85484c843f9ad25f90d76d0a634&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:33.089516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:33.187644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f091d-ea4d-4c6a-bc12-5ec2150b92ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:33.212636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:33.262773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:33.264635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.265423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.266082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.282067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:33.285015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:33.316404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:33.318378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:33.320143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:33.327933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 376/762] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:55:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:33.346394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:33.428898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6814-8afe-4465-88b3-1fe724f45c30 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:33.530217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:33.536942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:33.543800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.543800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.543800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] PATH_INFO: `/v3/services/network` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.543800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:33.543800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-24460169-37b1-4b6f-aa0a-94fc0d22d614 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:33.567434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:33.568823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:33.569876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:33.578193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 387/763] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:33 2022] GET /identity/v3/services/network => generated 88 bytes in 492 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:33.579906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77974-29e5-4642-97e6-24d0f64658ed None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.580397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77974-29e5-4642-97e6-24d0f64658ed None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.580835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77974-29e5-4642-97e6-24d0f64658ed None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.582760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 388/764] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:33.588996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.589563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.590057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.612172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:33.613798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:33.616783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea82df-618f-4e1d-a96c-2638879a0b52 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:33.685621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:33.686768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.687218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.687691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.689244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:33.689826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:33.692642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:33.724151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 377/765] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:55:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:33.725335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:33.749618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 389/766] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:33.749618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:33.874846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:33.910295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28ddca-391d-40c6-b38c-2112a6e8138f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:33.966028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:33.982402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] RBAC: Adding query filter params (name=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:33.993398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:33.999438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 378/767] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:34.001177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.002068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a67f24-8d06-4260-819d-ef83fd05b224 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.083834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.085500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.087263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.088332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.111851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:34.114915 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:34.139175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:34.140792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:34.142566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:34.142566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:34.142566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:34.142566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:34.144977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 390/768] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:34.146037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.228085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ff3c-849f-444f-9cb0-764c2fc0b677 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.315921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.318196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.319734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.320545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.346318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:34.346608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:34.359053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29f34-97bd-4eb2-84ef-656cf86bc8c2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:34.369400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:34.371204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:34.372848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:34.378620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 379/769] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:34.380578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.421215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.422025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.422268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.422624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.423672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] RBAC: Adding query filter params (type=network) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:34.424060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:34.425610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:34.434240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 391/770] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:34.435402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.513486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:34.593995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c16-37c7-4143-80d7-50302f01bd76 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.626376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02186d9-50b9-4ab8-ab75-cbe2c62045a0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.679352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9015-89e5-492a-b704-995f01838469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.682561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9015-89e5-492a-b704-995f01838469 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.683441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9015-89e5-492a-b704-995f01838469 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.684256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9015-89e5-492a-b704-995f01838469 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.685757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b9015-89e5-492a-b704-995f01838469 None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:34.686599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b9015-89e5-492a-b704-995f01838469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:34.689464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b9015-89e5-492a-b704-995f01838469 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:34.706647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.707846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.708348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.708814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 392/771] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:34.709108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.710388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:34.710842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:34.711592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9015-89e5-492a-b704-995f01838469 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.713355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae778a6c-ead2-4c33-89f7-f15f3864e4ae None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:34.739084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 380/772] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:34.741477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83634-a476-4de5-bee1-1f847b08e3cf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.741979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83634-a476-4de5-bee1-1f847b08e3cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.743773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83634-a476-4de5-bee1-1f847b08e3cf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.752959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 381/773] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:34.752959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab83634-a476-4de5-bee1-1f847b08e3cf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.775411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:34.922069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9015-89e5-492a-b704-995f01838469 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.926829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab83634-a476-4de5-bee1-1f847b08e3cf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:34.942006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:34.969371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.970122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.970379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.970673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.971459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] RBAC: Adding query filter params (interface=public, service_id=61dadf81879846f191f4ffb602f7fc21, region_id=RegionOne) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:34.971775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:34.973272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:34.975548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:34.978549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:34.979405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:34.979740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:34.987254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 393/774] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/endpoints?service_id=61dadf81879846f191f4ffb602f7fc21&interface=public®ion_id=RegionOne => generated 194 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:34.988251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:34.999108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.001522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-551895ba-116a-44bb-9952-87d746ae0461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:35.037159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:35.038385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:35.039358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:35.039358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:35.039358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:35.039358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:35.039358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 382/775] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:35.041666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.042143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.042622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.070428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:35.073244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:35.096111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:35.119942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b823-cecb-4e74-bfda-108dd2a91d9c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.169767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.170593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.170883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.171166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.179551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.181772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:35.199721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:35.201356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 394/776] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:35.202332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.209635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 383/777] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:35.209635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.335626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:35.350286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e39f0-0c00-4d2e-939e-f9cf9c1d5bf7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.391293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105202-e673-4ba4-997b-79e635a9fcb2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.405211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.405948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.406245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.406501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.407218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:35.407526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.409010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.423608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 384/778] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:35.425718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.445351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.446861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.447374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.447718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.448437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.450143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.455993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 395/779] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:35.456863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.479990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:35.656174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb481f0-0502-416b-bac4-ef054365cb49 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.656837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39a987-0f3b-403d-8d1d-3d6e4ab1b92d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.718318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.719079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.719369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.719648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.720326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.721768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.722475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.723362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.723806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.724252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.725083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:35.725398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.727205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10be59-cf68-42a0-9b80-bb8ec7270dd0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:35.736435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:35.738362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:35.740047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 396/780] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:35.744543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.748254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 385/781] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:35.753417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56c8e-b3f0-44ae-afe2-b7694c02ed23 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.753417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56c8e-b3f0-44ae-afe2-b7694c02ed23 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.753417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e56c8e-b3f0-44ae-afe2-b7694c02ed23 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.753417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 386/782] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:35.753417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e56c8e-b3f0-44ae-afe2-b7694c02ed23 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.771744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:35.871590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:35.920014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f214b-340c-4833-a37a-ac82e47d5fe3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.920472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e56c8e-b3f0-44ae-afe2-b7694c02ed23 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:35.978921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.980213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.980691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.981090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.983436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:35.984188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:35.984488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:35.984648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:35.985372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:35.985724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:35.987414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:35.999329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 387/783] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:35.999329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:35.999587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:36.000419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-47f898f8-b33c-40d3-8b77-b72c1089f9d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:36.017557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:36.019471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 397/784] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:55:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:36.021396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:36.025848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:36.042974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:36.044284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:36.130308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:36.149623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 398/785] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:36.149623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:36.173882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604d51-46db-4c32-81fd-9e122fd80576 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:36.248461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:36.250004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:36.250931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:36.251069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:36.254767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=1e0aca394e4f40c38b3f2db655c462f8, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:36.257226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:36.268036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:36.331903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02fd6a-3592-4401-a882-8ca59c4599a0 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:36.379993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:36.381161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:36.381713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:36.382053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:36.382991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:36.383678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:36.387477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:36.396970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 399/786] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:36.397941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:36.425612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 388/787] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:35 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:36.425612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:36.666108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cde2-bfd0-4cc3-93f8-8c6ddf38a9a1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:36.747790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb782b-0055-4166-b355-d843f3875710 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:36.812233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:36.813263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:36.813716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:36.814076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:36.817842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:36.829376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:36.848683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:36.850879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 389/788] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:36.853503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:36.933639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:36.949855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:36.951022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:36.951524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:36.952032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:36.954380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:36.954909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:36.958174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:36.968464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973f0f-3661-4cc2-836f-5327c5199605 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.000821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 400/789] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 600 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:37.000821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.019215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.020006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.020371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.020727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.022259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] RBAC: Adding query filter params (interface=public, service_id=60d548f92e6b4c088b4dc1dcdf239c2d, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:37.022866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.025820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.036214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 390/790] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:55:36 2022] GET /identity/v3/endpoints?service_id=60d548f92e6b4c088b4dc1dcdf239c2d&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:37.037336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.146317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:37.192324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1fe92-2cee-4abb-bcbb-62e9de381060 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.210828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185818c-3556-4cf9-aa05-309dfd57f740 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.262156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.263733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.264244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.264779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.266393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:37.267015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.267982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.268806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.269089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.269364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.270306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.285009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.286797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.289087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 401/791] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:37.291460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:37.314701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:37.315875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:37.316830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:37.316830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:37.316830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:37.316830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:37.316830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 391/792] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:37.321627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.400324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:37.480783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37644e-f869-49a7-9388-138a2765ef5b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.488475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29418622-543b-42ce-a3ce-5950b7fd8208 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.519412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:37.532709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.533703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.534142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.534592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.536131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.537807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.545504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 402/793] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/services => generated 772 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:37.546633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.588986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.590545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.591024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.591504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.636305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.639144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:37.680136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:37.681257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:37.682346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:37.682346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:37.682346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:37.682346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:37.687068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 392/794] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:37.688335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.692172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280397-aa4f-4976-9f17-181400fbea57 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.714459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:37.742934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.744106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.744565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.745002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.746010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:37.746564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.748275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.765366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 403/795] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:37.778749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:37.916071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00807a54-cb37-4176-8207-485160cb6c85 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.921111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da116c89-52f7-43f3-8ccc-2fca0e0a16ce None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:37.966005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.966886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.967180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.967467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.982646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.984151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:37.987892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:37.989061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:37.989563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:37.990072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:37.991521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:37.992071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:37.995935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-d1b7993d-9b88-4a95-8d44-9819a055ed74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:38.002825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:38.003831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:38.004722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 404/796] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:38.010009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e823-240a-43e5-918c-55fc6f5e3d0c None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.010368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e823-240a-43e5-918c-55fc6f5e3d0c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.010657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e823-240a-43e5-918c-55fc6f5e3d0c None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.013310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 405/797] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:38.020012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.020511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.020933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.025554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 393/798] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:38.027333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.046267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:38.047511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:38.078902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.098061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.161009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 406/799] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:38.161009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.227894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd489-7bb3-4a8a-a270-28973ed0a3bd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.276703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.277669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.278118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.279275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.280311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:38.280791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.283458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.314068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 394/800] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:38.314068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.375777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c29d8-751c-44db-b209-b0ec754a3bed None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.434568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.434771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.437049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.437533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.438088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.456358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a0-cb5d-47ca-bab9-e78998de98b7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.458935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.463116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:38.485952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:38.486964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:38.487896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 407/801] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:38.489024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.509757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.510738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.511026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.511303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] PATH_INFO: `/v3/services/network` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.512418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.513561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.522722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:38.528974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:38.530281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 13:55:38.531126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:38.535333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 395/802] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:38.536346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.617018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5882d4-6a7a-431c-95a7-35f98635e998 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.657913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.659193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.659704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.660183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/a4467c612a534ae9871d4a6579e19bb0/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.665671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3d05-b7a4-455a-bb80-5ef8909fe39c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.678143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=a4467c612a534ae9871d4a6579e19bb0, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.680661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.708223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.709188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.709663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.710071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.711304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:38.711703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.713464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.736846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 396/803] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:38.741154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.751890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.780885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 408/804] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:38 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/a4467c612a534ae9871d4a6579e19bb0/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:38.783247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:38.897106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a65d8-4d8c-474b-8e07-003b60d464c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.955067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f7516-ed5f-4055-91e5-3de9279196ee None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:38.962563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:38.964060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.964748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.965465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.967435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] RBAC: Adding query filter params (name=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:38.968412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:38.971380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c571abd-f834-42a2-a59b-546e72027143 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:38.983415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 397/805] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:38.984476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:38.987132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269680bb-dcd2-49df-a8ba-371098918f15 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:38.988033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269680bb-dcd2-49df-a8ba-371098918f15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:38.988911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269680bb-dcd2-49df-a8ba-371098918f15 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:38.998001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 398/806] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:39.000215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269680bb-dcd2-49df-a8ba-371098918f15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.002464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.003472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.003764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.004042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.025848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:39.029187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-095a41d3-7fc8-418c-9faf-8efa01cca8fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:39.070613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:39.072126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:39.073007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:39.073007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:39.073007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:39.073007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:39.076754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 409/807] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:39.077729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.078326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.078916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.096972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:39.112884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:39.116509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:39.143239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269680bb-dcd2-49df-a8ba-371098918f15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:39.192464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.193148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.194509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.194800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.195787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:39.196081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:39.197761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:39.204754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 399/808] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:55:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:39.206352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.257336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 410/809] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:39.259572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.361037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05125d9-e626-4432-af3e-14edad8833bd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:39.388483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:39.425326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.426573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.427002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.427454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.428335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:39.428804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:39.431013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:39.442005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:39.453518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 400/810] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:39.453518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.504282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f674-7869-47f2-853d-bfaf968fabc2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:39.584257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.585800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.587037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.587766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.590273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:39.594321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:39.596900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc859c-fc65-41f6-9803-8402334cf61b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:39.640503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.641364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.641854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.642253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.659146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:39.668667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:39.675004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 401/811] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:39.676042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.755898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 411/812] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:55:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:39.755898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:39.778460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:39.888400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f683951-82e8-4ea6-adcc-a0de9fa31d13 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:39.985088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:39.988370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:39.988858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:39.989349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:39.994791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614acb3a-62b6-4bd5-97e0-05c191784a6d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.005538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.007917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.021609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:40.029709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:40.033393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:40.034317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 402/813] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:40.042430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.080973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.083266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.084060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.084731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.087780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:40.088651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.093009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.110789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 412/814] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:40.121280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.210898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a9834-d3d5-4460-8697-a33bd7353f7e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.224165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:40.255096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.255789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.256077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.256365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.257290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:40.257625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.259411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7a71-0f5b-402a-9d6d-c27f6eaf5d01 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.274459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 403/815] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:40.275420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04e6b6-7fcd-46ed-acdc-a6cbbc620795 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.275925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfd0f-29f6-4d29-9c4b-8bdc5b613daf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.276275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfd0f-29f6-4d29-9c4b-8bdc5b613daf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.276561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfd0f-29f6-4d29-9c4b-8bdc5b613daf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.281615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 404/816] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:40.283036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfd0f-29f6-4d29-9c4b-8bdc5b613daf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.338909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.340256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.340707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.341273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.362469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.365426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-89254648-0760-4b7e-ad30-5020a3a2a00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:40.403688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:40.405060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:40.405998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:40.405998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:40.405998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:40.405998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:40.406218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 413/817] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:40.408434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.408948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.409453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.437118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:40.438393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:40.461748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:40.485133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfd0f-29f6-4d29-9c4b-8bdc5b613daf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.532323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 414/818] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:40.534358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.553536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.555750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.556735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.557486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/d459c85484c843f9ad25f90d76d0a634/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.560786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=d459c85484c843f9ad25f90d76d0a634, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.563511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.644856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 405/819] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:40 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/d459c85484c843f9ad25f90d76d0a634/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:40.655440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.677617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bcae-86f0-4fcf-9ef2-2eb41d3d03dd None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.726494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.727437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.727801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.728206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.729004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:40.729319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.730823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.753884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 415/820] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:40.756147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:40.758941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:40.783605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:40.878878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603d7b-9b96-4277-8e99-7e5e951bb54c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.930946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:40.932077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:40.932879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:40.933176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:40.934159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:40.936317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:40.942275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9de54-b5e3-423d-92b0-99384bdd8bab None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:40.952136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:40.953157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:40.954028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 406/821] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:40.962758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.014063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.014950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.015335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.015728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.025798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.027488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:41.044259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:41.045332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:55:41.046308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:41.048625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 416/822] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:41.057839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.107804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:41.116109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977eedf-25c7-41ab-b271-fa70aeef5355 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:41.177403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.178178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.178556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.178839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.179560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:41.180433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.181886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.187877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 407/823] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:41.194136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.206988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:41.251631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dedc7-ee36-449b-9082-3b41e73103bf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:41.315682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.316969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.317456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.317982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.319452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:41.320149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.324687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b34a-a6c0-42b1-84da-9ca6007a76c9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.359656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca046aaa-9cf9-42cf-81a0-85ab55e564b2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:41.363736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 417/824] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:55:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:41.365572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ced75-a211-44be-9641-674f66113efa None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.366151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ced75-a211-44be-9641-674f66113efa None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.366641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ced75-a211-44be-9641-674f66113efa None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.370018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 418/825] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:41.371135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ced75-a211-44be-9641-674f66113efa None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.408007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.408851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.409207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.409490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.410340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:41.410693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.412683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7655ba-7e41-428b-9fe0-af1178472e5f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.420403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 408/826] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Jul 11 13:55:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:41.422649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.423135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.423614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.447052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:41.448390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:41.472834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:41.536336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ced75-a211-44be-9641-674f66113efa None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:41.544244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 409/827] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:41.545146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.593802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:41.600160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.600841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.601121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.603648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.689594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a7ef-9568-4e73-8fa1-67dc09c08295 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:41.699303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.700859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.734300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:41.735351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:41.735798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:41.736328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:41.737189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:41.739313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:41.828395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 410/828] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:55:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:41.830504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.848612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 419/829] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:55:41.858992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:41.860735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:41.934057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:42.046906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb823c-7ca5-4fdb-bc58-ce578c88fea9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.087432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12917694-76d7-4011-9aa6-0dfc8dcfc0ff None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.099727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.100903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.101334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.101937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.131166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:42.147620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:42.149223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:42.150799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 411/830] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:42.156346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.158708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.159528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.159810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.160137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.172729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.174271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:42.194772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:42.198689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:42.200889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:42.200889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:42.200889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:42.200889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:42.200889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 420/831] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:42.205887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.240204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:42.287975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6078-ad46-4841-bcb5-f65e79084e6e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.321962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:42.330993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.332110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.332110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.332365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.333267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:42.333723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.335384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.343252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37b5d8-9c0b-494b-bc96-bc3bd607e645 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.345901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 412/832] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:42.355293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.394620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.395339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.395628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.395919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.396979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:42.397167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.399352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.414973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 421/833] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:42.420512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.537440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62500cd-52bf-4f27-8d85-a7e307728d23 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.595083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:42.609341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef175ed-96b8-47a3-99f4-4b7ea5f0e395 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.616366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.617527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.617854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.618128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.634438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.636351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:42.660961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:42.662821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:42.665966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:42.665966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:42.665966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:42.665966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:42.667965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 413/834] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:42.668980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.701716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.702613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.702909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.703163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.712847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.714567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:42.732274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:42.733382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:42.735178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 422/835] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:42.739673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.746483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:42.832171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066f9d-cad4-4791-ab41-026482cc0966 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.869700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c94af-5c74-4495-bffc-e4f9cbf999cc None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:42.875060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.875740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.876021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.876296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.877027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:42.877329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.878837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.894804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 414/836] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:42.904028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.920457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:42.921546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:42.922111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:42.922657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:42.923743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:42.924263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:42.925999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:42.939878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 423/837] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:42.948017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:42.999265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.051993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.122424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc24c4-6559-4024-b6b8-a43ccd560fc6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.124071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d7d-03a6-4000-97a0-c416ec3a541f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.183929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:43.184608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.184901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.185186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.186070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:43.186390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:43.187868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:43.189531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:43.191130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.191814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.192492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.196836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 424/838] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:43.213879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:43.215948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-55e62a21-e201-4df0-81e3-a2807c3d3d77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:43.249624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:43.251809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:43.254016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:43.258519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 415/839] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:55:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:43.267933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:43.305651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4e68-aedb-4840-8c7f-e538e4d8eefd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.306156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4e68-aedb-4840-8c7f-e538e4d8eefd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.307166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4e68-aedb-4840-8c7f-e538e4d8eefd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.310091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 416/840] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:43.324082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.324648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.325198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.360134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:43.363691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:43.431506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230fc65-be59-4b7f-90b1-1bdd5e0a58b6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.468444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.479409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:43.484566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:43.501260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 417/841] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:43.504732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 425/842] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:55:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:43.514088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:43.556753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.564384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:43.660860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e90cd-17c6-40dc-81b0-597ec51f4e8c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.693374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98ceb-5f80-4c1a-8620-679cdaa2e1d6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.703477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:43.704152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.704426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.704726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.745137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:43.746187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:43.746478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:43.747731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:43.763481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:43.774358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:43.776365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:43.778503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 426/843] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:43.792285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:43.794942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:43.798046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:43.853154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.860975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:43.936317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163801c9-38e1-4724-aceb-564ae919e95d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:43.990752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 418/844] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:55:43.991533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.000622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.002441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.003242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.004169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.006163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:44.007034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.010453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.031678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 427/845] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:44.037632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.167212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88214f-b1e7-438c-ad19-865cbe0e4ede None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:44.219276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:44.228607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32e28-7049-4bcd-9d18-f5972154b177 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:44.233071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.234768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.234768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.235237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.246651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:44.253359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.255652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e395ddef-ddce-4354-9b48-3f76552736a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:44.279897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:44.282027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:44.284320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:44.284320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:44.284320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:44.284320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:44.284320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 419/846] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:44.285200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.285835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.286088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.286400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.291060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573b84-e410-41cf-af5d-9f79c799331c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.291520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573b84-e410-41cf-af5d-9f79c799331c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.291933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573b84-e410-41cf-af5d-9f79c799331c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.298275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 420/847] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:44.298275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573b84-e410-41cf-af5d-9f79c799331c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.303062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.305099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ac025e60-3efa-4e34-9470-122de34af2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:44.324807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:44.326569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 428/848] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:44.327914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.328303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.328603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.357356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:44.358612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:44.449624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 429/849] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:44.449624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.492194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573b84-e410-41cf-af5d-9f79c799331c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:44.541109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.542202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.542664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.543102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.544144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:44.544606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.546310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.564462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 421/850] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:44.565995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.621311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:44.622786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:44.637551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d1bd-e00b-45b5-9df0-8b6eba9346ba None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:44.692792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.694221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.695584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.696332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.697823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:44.698649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.702714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.724393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c234da-014f-4afc-ac9e-b1fd3ec400d3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:44.733818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 430/851] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:44.733818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.777756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:44.778686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:44.779031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:44.779397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:44.780201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:44.781686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:44.795991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:44.797885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:44.799584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:44.802608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 422/852] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:44.803640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:44.944194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd4b9-55cc-4b65-b935-44faf2952934 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.019894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.021968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.022706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.023992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.038280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.042195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.057257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc1ba-730c-4bc3-aae8-362bc645a264 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.060487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:45.076898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:45.077927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:45.078894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:45.079313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 431/853] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:45.081061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.105825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.112814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.113855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.114137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.118533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.124770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.126360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:45.143739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:45.145974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 423/854] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:55:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:45.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.288443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3180-93a1-41eb-a33e-79b699bf9146 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.297317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bca08-a90a-416c-be48-442f959198f6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.346226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.347530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.347530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.348096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.349437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:45.349993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.353614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.358562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.359643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.360123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.360585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.361886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:45.362559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.365090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.374875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 432/855] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:45.376320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.393680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 424/856] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:45.393680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.422845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.485731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.515817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe622eb-8b5f-4399-81a1-bb9dc1fb6fce None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.548653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2d3-3bb6-4366-8053-796acf522c2d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.566274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.566975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.567258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.567537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.568527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:45.568800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.570523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.591002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 433/857] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:45.592012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.609139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.609957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.610120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.610304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.611025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:45.611327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.612723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.629628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 425/858] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:45.629628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:45.772458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.786409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4d15-e5eb-4037-8c13-fe5766ffd46b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.792787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bde5a-1ba0-4f55-9be4-ceaef3fcc94b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:45.844224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.844912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.845186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.845476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.850333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:45.864212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:45.864826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.865270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.865958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.869422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=a4467c612a534ae9871d4a6579e19bb0) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:45.869422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.869422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212bc6-bac5-4fbe-9e74-ea04dede5a9a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:45.877168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 434/859] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/role_assignments?user.id=a4467c612a534ae9871d4a6579e19bb0&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:45.885767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9017c-9bcf-4629-8bf8-fb507139b77e None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.885767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9017c-9bcf-4629-8bf8-fb507139b77e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.885767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9017c-9bcf-4629-8bf8-fb507139b77e None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.885767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 435/860] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:45.890586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:45.891052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:45.891350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:45.921859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:45.924153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:45.940780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:45.942497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.019649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 436/861] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:55:46.056667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.059946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:46.085416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 426/862] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:55:46.098345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.251734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b886d0-9762-4906-81b9-5591b8d0e522 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.283205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a1b3-96e3-4dc2-9818-061a840cdb39 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.296595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.297446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.297768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.298050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.298729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.300177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:46.314308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:46.316207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:46.317864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 437/863] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:46.319594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:46.322729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.382191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.384012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.384298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.384570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.402870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.404645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:46.423706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:46.424765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:46.425785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:46.425785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:46.425785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:46.425785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:46.425785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 427/864] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:46.435519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.491297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278f1b-b2dc-4426-9d29-606a2a586abf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.499324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:46.560377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.561929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.562589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.563277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.565361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:46.566120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.569702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.581214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 438/865] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:46.586970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.604210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045e129-3e76-42e0-9fab-b853ced5525d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.653840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.654572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.655276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.655636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.656443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:46.656813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.658877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.667168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:46.676197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 428/866] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:46.682266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:46.760332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1422f1-c385-44f1-9e5c-2a0fe5ab227a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.801204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.802369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.802889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.803286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.804037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:46.805198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.807531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.815298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 439/867] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:46.833143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:46.838166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531cdfd-72ea-456b-995c-935a13021f22 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:46.880304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:46.881132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:46.881417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:46.881747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:46.891575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:46.893073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:46.910852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:46.911812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:46.912705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:46.913123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 429/868] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:46.919280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:47.075197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c977f7c-d5e9-472a-8aa0-45eba75a0f13 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:47.094787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:47.114313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:47.115056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:47.115345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:47.115675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:47.116577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:47.117713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:47.119188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5601b-cb35-4d94-a27a-eb3bd5d15239 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:47.133589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 440/869] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:47.140888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:47.257602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8815-37d3-4e85-8596-189a1dbdbfd2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:47.298311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:47.299027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:47.299320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:47.299599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:47.300435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=d459c85484c843f9ad25f90d76d0a634) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:47.300746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:47.302309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442921a-1f81-4659-9b31-28f11a997a80 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:47.309394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 430/870] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:47 2022] GET /identity/v3/role_assignments?user.id=d459c85484c843f9ad25f90d76d0a634&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:47.994491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180676-f6f4-411d-a36c-cb11f108af2f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:47.995474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180676-f6f4-411d-a36c-cb11f108af2f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:47.995957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180676-f6f4-411d-a36c-cb11f108af2f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:47.998169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 441/871] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:48.004406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193644c9-0baa-4900-b11d-7bce75defd34 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.005418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193644c9-0baa-4900-b11d-7bce75defd34 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.005936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193644c9-0baa-4900-b11d-7bce75defd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.025431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-193644c9-0baa-4900-b11d-7bce75defd34 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:48.027232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-193644c9-0baa-4900-b11d-7bce75defd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:48.049091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:48.109066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 431/872] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:48.133558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180676-f6f4-411d-a36c-cb11f108af2f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:48.205846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e03-24fb-4954-bd6f-1531e389bbaa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.206039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e03-24fb-4954-bd6f-1531e389bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.206314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e03-24fb-4954-bd6f-1531e389bbaa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.207898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 432/873] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:48.215312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.215639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.215883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.237778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:48.239456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:48.272466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180676-f6f4-411d-a36c-cb11f108af2f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:48.327895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:48.328576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.328864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.329222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.330030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:48.331486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:48.339176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 433/874] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:48.364213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:48.470350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:48.501650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae6ced-8026-4d04-a202-3ac5a8d719c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:48.502121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 442/875] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:55:48 2022] POST /identity/v3/services => generated 251 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:48.582943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364927d8-108e-49ab-b449-da077726531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:48.584434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364927d8-108e-49ab-b449-da077726531c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.584958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364927d8-108e-49ab-b449-da077726531c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.586231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364927d8-108e-49ab-b449-da077726531c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.608735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364927d8-108e-49ab-b449-da077726531c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-364927d8-108e-49ab-b449-da077726531c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:48.626884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:48.627919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:55:48.628737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:48.629911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 434/876] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:55:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:48.639648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:48.729458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:48.847027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579271c-db5d-4c02-b97e-cfc909692165 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:48.919964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:48.921163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:48.921691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:48.922187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:48.923632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:48.924194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:48.926891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:48.945895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 443/877] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:55:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:48.952129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364927d8-108e-49ab-b449-da077726531c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:49.099054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364927d8-108e-49ab-b449-da077726531c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:49.139574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:49.140393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.140674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.140942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.154109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:49.158847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:49.161678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:49.197409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:49.199565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:49.201729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:49.201729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:49.201729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:49.201729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:49.201729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 435/878] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:49.206962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:49.371386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:49.377349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03228698-e5bb-4eb2-a550-45ba3f6e5063 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:49.433850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:49.434544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.434898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.435182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.435929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:49.436238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:49.437690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42573-2836-426d-b6f6-0775cf463059 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:49.451976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 444/879] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:49.457566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:49.589344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e439-85bd-4955-b4b6-377d7e553c58 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.590049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e439-85bd-4955-b4b6-377d7e553c58 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.590612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e439-85bd-4955-b4b6-377d7e553c58 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.593221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 445/880] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:55:49.599343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2a4d-c07c-4498-ba04-584283c38a72 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.599972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2a4d-c07c-4498-ba04-584283c38a72 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.600302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6568-ecc3-42ab-8a69-73fc08f9f63e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:49.600770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2a4d-c07c-4498-ba04-584283c38a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.623299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6f5e2a4d-c07c-4498-ba04-584283c38a72 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:49.626118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6f5e2a4d-c07c-4498-ba04-584283c38a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:49.641697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:49.642550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.642990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.643290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.653078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:49.655044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:49.671686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:49.673507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:49.675365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 436/881] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:55:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:49.682071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:49.752577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 446/882] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:55:49.754035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbffd5-78da-49f7-b24c-6a6e81bc7c38 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.754491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbffd5-78da-49f7-b24c-6a6e81bc7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.754938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbffd5-78da-49f7-b24c-6a6e81bc7c38 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.756267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 447/883] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:49.765628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.766137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.766625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.783133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:49.796628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:49.800420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:49.875097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f7b2-a456-4241-bdb0-93ef7ac1af61 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:49.921618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 448/884] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:49.921618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:49.943106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:49.943801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:49.944110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:49.944350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:49.945950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:49.946261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:49.947739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:49.968718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:49.976861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 437/885] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:55:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:49.978543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:50.127164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7e7e-ce90-46b7-9593-e224342ed8f8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:50.160555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b2233-c566-42cb-a785-2b35979e781e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:50.181089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:50.191553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:50.192852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:50.194289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:50.194289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:50.194730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:50.198058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:50.219586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:50.222624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:50.224588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 449/886] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:50.228785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:50.236564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:50.237674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:50.238122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:50.238582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:50.240530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:50.243365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:50.326130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 438/887] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:55:49 2022] POST /identity/v3/services => generated 269 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:50.327234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:50.384491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:50.423397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c209-71fd-433d-b272-cf2cb1fac655 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:50.503613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:50.505258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:50.505467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:50.505905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:50.546091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43e54-7f42-4529-a7f3-9d4495683f42 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:50.614987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:50.616870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:50.618119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:50.618755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:50.620341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:50.621078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:50.623870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:50.633345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 439/888] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:55:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:50.642551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:50.647562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:50.652071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:50.683823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:50.764471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277517a9-ada7-4105-8341-f7d10ce00fe7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:50.809568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:50.810467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:50.810819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:50.811152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:50.811935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:50.812301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:50.813820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:50.825621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 440/889] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:55:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:50.832865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:50.861856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 450/890] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:55:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:55:50.871237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.003738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:51.010448 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed84-5159-4b4c-b14d-ac33cd7e83ad None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.055920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.058421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.059096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.059823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.079315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.082542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6f49917c-9014-4ff2-bc38-8fffb757cbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:51.114389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:51.115462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:51.117562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:51.117562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:51.117562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:51.117562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:51.125709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 441/891] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:51.128189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.139379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d8ca-5508-46b4-a9c9-3b7521b670d3 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.139719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d8ca-5508-46b4-a9c9-3b7521b670d3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.140077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d8ca-5508-46b4-a9c9-3b7521b670d3 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.141618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 442/892] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:51.147865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.148206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.148426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.168453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:51.169610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:51.291463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 443/893] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:55:51.310804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642137-99bd-48c1-a2c2-5a241abff765 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.337748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.354685 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.355379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.355667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.355994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.356735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:51.357077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.359079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.375094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 451/894] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:51.381087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.466127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:51.482070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:51.493977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebff26e-8969-4397-afbd-f9ab1def75c8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.544851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.545901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.546283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.546679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.547519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.549469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:51.564331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:51.566203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:51.567479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:51.569035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 444/895] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:51.575721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.584869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efff7-1ceb-4d5f-94ee-28589c8abb3a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.641636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.642868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.643342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.643794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.653385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.655994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:51.675457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:51.676395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:51.677338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:51.681738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 452/896] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:51.691461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.754930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910a7b8-962b-494f-9fda-cf2105b9b2e6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.808547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.809277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.809560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.809876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.810589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:51.810889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.812496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.823495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 445/897] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:51.824852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.837183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:51.849267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:51.853300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731ac0-24c6-488c-9711-abb84391d11c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.897039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.898323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.898851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.899310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.900516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:51.901182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.903012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.919082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 453/898] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:51.929684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:51.946478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d181a-eb93-45f9-b52c-3fcce452ce40 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:51.987424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:51.988217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:51.988508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:51.988786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:51.989505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:51.989852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:51.991393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:51.999025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 446/899] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:52.006766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:52.140696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:52.151651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa498-1383-4a8a-8ce0-174713dc270c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:52.202770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9027-0ce1-4319-aee3-183ad347225a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:52.215086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:52.216438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:52.217069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:52.217637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:52.219114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] RBAC: Adding query filter params (role.id=f012170a08bf465e87567cad04e8dacb, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=a4467c612a534ae9871d4a6579e19bb0) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:52.219960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:52.222853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:52.232700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 454/900] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:55:51 2022] GET /identity/v3/role_assignments?user.id=a4467c612a534ae9871d4a6579e19bb0&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=f012170a08bf465e87567cad04e8dacb => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:52.286043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:52.287866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:52.288656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:52.289395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:52.291304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] RBAC: Adding query filter params (interface=public, service_id=fdd272c217584d3d896290d5e30a859d, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:52.292102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:52.295125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3edb3-d3b0-41e4-b685-35be71d786e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:52.313886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 447/901] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:55:52 2022] GET /identity/v3/endpoints?service_id=fdd272c217584d3d896290d5e30a859d&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:52.317713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:52.378210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:52.542527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae78a9-568b-4253-a004-e1126240e3fe None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:52.614226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:52.615717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:52.616710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:52.617455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:52.619083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:52.622103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177cc5-89e3-4bf8-a96f-7486c304283d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:52.635302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 455/902] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:55:52 2022] GET /identity/v3/services => generated 1268 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 13:55:52.925617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a266-824b-4cc5-b2b5-d5c43d38200a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:52.926052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a266-824b-4cc5-b2b5-d5c43d38200a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:52.926205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a266-824b-4cc5-b2b5-d5c43d38200a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:52.927888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 448/903] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:55:52.934219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfcce-297b-4318-b10b-5db4e7273548 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:52.934497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfcce-297b-4318-b10b-5db4e7273548 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:52.934863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfcce-297b-4318-b10b-5db4e7273548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:52.953663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cf4dfcce-297b-4318-b10b-5db4e7273548 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:52.954912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cf4dfcce-297b-4318-b10b-5db4e7273548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:53.042870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 456/904] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:53.066744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379a266-824b-4cc5-b2b5-d5c43d38200a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:53.159992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607519-9b55-4c44-ab6e-02dea95e93cc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.160237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607519-9b55-4c44-ab6e-02dea95e93cc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.160570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607519-9b55-4c44-ab6e-02dea95e93cc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.162330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 457/905] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:53.167987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.168263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.168569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.199899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379a266-824b-4cc5-b2b5-d5c43d38200a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:53.201703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:53.204143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:53.234224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:53.248566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:53.253483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.253483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.253483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.253483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:53.253483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:53.255274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:53.266654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:53.268538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:53.270213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 449/906] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Jul 11 13:55:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:55:53.275650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:53.344838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 458/907] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:55:53.369075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:53.403487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcc912-6bf0-42af-aa8b-3037563b3cda None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:53.444043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:53.445178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.445541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.446120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.446959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:53.447264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:53.448739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:53.457213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 450/908] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:53.465040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:53.531659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3c6f-bdb2-416d-b555-64dc670701cd None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:53.578109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:53.578798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.579077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.579362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.580117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:53.581531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:53.594546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:53.665557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 459/909] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:55:53 2022] POST /identity/v3/services => generated 241 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:55:53.667544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70fa40-0994-4ffb-a02b-5098015ad801 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:53.722631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:53.723290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:53.723570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:53.723845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:53.724561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:53.724864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:53.726458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:53.733020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 451/910] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:53.739205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:53.757525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:53.935301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e0f0-8bda-45e0-9fe6-a727b9cf5b60 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:54.009379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:54.010548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:54.011123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:54.011632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:54.013543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] RBAC: Adding query filter params (interface=public, service_id=c4f90c04c50844968f4775084a977fd0, region_id=RegionOne) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:54.014152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:54.016979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7045f9-5097-45b0-95c4-f4df389e6c59 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:54.028987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 460/911] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:55:53 2022] GET /identity/v3/endpoints?service_id=c4f90c04c50844968f4775084a977fd0&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:54.038847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:54.187393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febdd6f-c72f-4995-984d-fb682023b54b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:54.214735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:54.227085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:54.227772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:54.228052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:54.228326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:54.229021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:54.230455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cea52c-e685-4c21-b367-a2e3f4f8cc7f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:54.237806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 452/912] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:55:54 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 13:55:54.551728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b51a-9468-41ff-a177-0f9ede9458ad None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:54.552738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b51a-9468-41ff-a177-0f9ede9458ad None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:54.553216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b51a-9468-41ff-a177-0f9ede9458ad None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:54.556230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 461/913] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:54.562239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:54.563218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:54.563710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:54.582512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:54.584085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:54.677736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 453/914] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:54.703120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b51a-9468-41ff-a177-0f9ede9458ad None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:54.826766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:54.874386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b51a-9468-41ff-a177-0f9ede9458ad None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:54.952177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:54.953662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:54.954177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:54.954690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:54.976903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:55:54.994918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:54.995963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:55:54.996857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:54.997947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 462/915] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:55:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:55.004683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:55.123223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743d01-8864-43fb-85de-77a19f73a1ae None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:55.158278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:55.172147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:55.176921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.176921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.176921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.176921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:55.176921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:55.179127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098fa52-363f-4b86-8893-b07f1f9db4cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:55.197908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 454/916] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:55:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:55.203621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:55.337267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637789-551b-4afe-9cd9-1188dc83fae4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.337982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637789-551b-4afe-9cd9-1188dc83fae4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.338504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637789-551b-4afe-9cd9-1188dc83fae4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.344172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 455/917] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:55.346438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.346944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.347417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.367324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:55.369143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:55.424137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78723-a305-4cf6-9d58-4712189c8638 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:55.493266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:55.503142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:55.504859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.505561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.507193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.507359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 456/918] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:55.537098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:55.540482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:55.552328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:55.578466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:55.580755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:55.583118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:55.583118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:55.583118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:55.583118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:55.585824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 463/919] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:55.591400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:55.755756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b7104-14b9-4015-a637-aa35476e03b8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:55.809122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2fec5-c128-4419-b2c1-858e52502fd0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:55.822001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:55.833086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:55.834524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.843648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.844537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.845875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:55.848473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:55.874567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:55.876440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 13:55:55.878602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:55.883907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 457/920] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:55.885646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:55.886830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.887423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.887979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.889700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:55.890264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:55.890981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:55.893053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fe26-88e9-4ce0-8915-d06ea72a0fbf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:55.915528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 464/921] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:55:55.916991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c5-4123-46c3-acf2-2fc4eda6248a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.917280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c5-4123-46c3-acf2-2fc4eda6248a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.917558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c5-4123-46c3-acf2-2fc4eda6248a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.919135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 465/922] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:55.926459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:55.926871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:55.927144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:55.952412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:55.954288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:56.013298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.049644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 466/923] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:55:56.049644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.078473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b84b2-30a0-4e95-9e61-f92472841af8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.142220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.143153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.143618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.144134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.145056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:56.145563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.148457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.156613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 458/924] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:56.158063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.221264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92d8b-fb39-4a51-8cec-5910a01f79c9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.228819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.282456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.283852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.284579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.285087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.295757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.313639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.313779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ebe3-e164-444f-918e-cf64ee0c239e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:55:56.315065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:56.315973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:56.316901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 467/925] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:56.318587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.353553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.354411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.354691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.354970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.355619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.357134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.363662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:56.370906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:56.377229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:56.378226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 459/926] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:56.379029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.459099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc406c0-cc36-41b2-8962-c74debc8a44e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.519398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.520080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.520365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.520643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.521417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:56.521755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.523836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.536251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 468/927] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:56.537143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.545221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e572e-de4c-4d81-97ee-19e73b95fcc3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.550014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.607979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.608700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.608966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.609243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.610149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:56.610455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.611930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.633252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 460/928] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:56.633964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.674400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.678548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ca0ca-8cf3-4f9a-8dba-c756f8e69415 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.725890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.726659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.726944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.727226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.727956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:56.729045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.729701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.736209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 469/929] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:56.737535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.770304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68890f-1176-4e0f-9072-5b1c232e5caa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.810393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.811073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.811394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.811674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.812433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.813944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b7b4-3cca-4c52-9afe-d7d29fdb3355 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.882826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2070-7159-4bed-b343-b227f40519ef None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:56.924884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:56.925742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.926025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.926299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.929930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 461/930] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:55:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:55:56.931330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d255d5-5626-454a-8e00-160820064dde None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.931618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d255d5-5626-454a-8e00-160820064dde None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.931899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d255d5-5626-454a-8e00-160820064dde None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:56.933269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 462/931] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:55:56.934127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d255d5-5626-454a-8e00-160820064dde None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:56.952987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:56.955362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:56.971883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-0249be87-4abe-4545-8da2-77124fc2bb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:55:56.981314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:56.983062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 470/932] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:56.984682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.003473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:55:57.004746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:55:57.018246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:57.119262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 471/933] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:55:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:55:57.121016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.127873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d255d5-5626-454a-8e00-160820064dde None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.200952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.202857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.203721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.204211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.206274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:57.207193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.210152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.224034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 463/934] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:55:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:57.229276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.250165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2afc8-5c1e-4b06-a315-3aae9974181d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.308209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.309373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.309917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.310581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.311807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:57.312354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.315112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.332789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:57.348063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 472/935] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:57.348063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.348442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:57.389148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5004-2e9e-4431-83bf-267d3fbbd98e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.441871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.442706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.442990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.443268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.443936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.445396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:57.459584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:57.460832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:57.461848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 464/936] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:57.462702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.499615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30057c-0bca-4005-a64f-499c1ab7d8fa None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.541265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.542570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.542852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.543138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.544352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] RBAC: Adding query filter params (interface=public, service_id=3b59d42bc09046179db5542d124d5f47, region_id=RegionOne) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:57.544673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.546714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.561598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 473/937] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/endpoints?service_id=3b59d42bc09046179db5542d124d5f47&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:57.561598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.598720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d4a7d-cb08-46d6-9f4f-2ead04018997 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.652133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:57.655799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.657222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.657763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.658224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.673078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.675895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.681602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:55:57.705792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:55:57.710498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:55:57.711391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:55:57.711897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425fc4d-3cd8-43f5-bd7a-f2af51a954f7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.712345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 465/938] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:55:57.712345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.778440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.780063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.780619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.781132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.782527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:57.783081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.785763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.795606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 474/939] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:57.797046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:57.871184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27e5e-cf5d-4dcf-adf4-6445298f33e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:57.924775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:57.925546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:57.926091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:57.926750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:57.928237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:57.931286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:57.946046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 466/940] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/services => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 13:55:57.947281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:58.000613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95abc2-abce-4891-91ce-d7abc429a511 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:58.044704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:58.056727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:58.058003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:58.058522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:58.069786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:58.069786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:58.069786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:58.069786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:58.069786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:58.085694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 475/941] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:58.097518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:58.116810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f501b-d7cd-4c78-ab09-a68f324225f9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:58.177313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:58.178389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:58.179342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:58.179614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:58.180971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:55:58.181271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:58.183052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:58.193082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 467/942] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:55:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:55:58.200433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:55:58.268849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b32be-0eee-490b-b7e9-591a9b44b606 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:58.315241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:58.316164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:58.316449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:58.316736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/a4467c612a534ae9871d4a6579e19bb0/roles/f012170a08bf465e87567cad04e8dacb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:58.319882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=a4467c612a534ae9871d4a6579e19bb0, role_id=f012170a08bf465e87567cad04e8dacb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:58.322244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714168e-752c-4f9e-bb35-2bead8e91396 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:58.325132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92893ff-ef5b-48a6-8bcf-7cc1c01bc4f6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:55:58.356886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:55:58.367133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:55:58.367814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:55:58.368225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:55:58.368383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:55:58.369110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:55:58.370560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73a281-db4c-4c59-b3ef-3d2099933185 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:55:58.461864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 476/943] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:55:58 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/a4467c612a534ae9871d4a6579e19bb0/roles/f012170a08bf465e87567cad04e8dacb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:55:58.506629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 468/944] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:55:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:56:00.143029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61df9ff-b32f-4777-a0ad-74d2092b9ee3 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.144065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61df9ff-b32f-4777-a0ad-74d2092b9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.144574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61df9ff-b32f-4777-a0ad-74d2092b9ee3 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.149505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 477/945] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:00.158901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.159642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.159800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.191603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682942e7-927b-4e60-b9eb-143653979261 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.191891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:00.192363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682942e7-927b-4e60-b9eb-143653979261 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.192613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682942e7-927b-4e60-b9eb-143653979261 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.193008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:00.195797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 478/946] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:00.201261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.201549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.201883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.220980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:00.222317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:00.282206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:00.332506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 469/947] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:00.334516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 479/948] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:00.357942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:00.389033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:00.494866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4503-dd89-40eb-9925-8f417d36eac1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:00.516848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:00.574215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:00.577135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.577658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.578429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.579821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:00.583745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:00.586713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING keystone.server.flask.common [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 13:56:00.637494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a3a9-ef29-4fc6-8c17-fd4dac83e14d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:00.675935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.sql.core [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 13:56:00.675935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 13:56:00.675935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [parameters: {'id': '59848f1f132f4383b5012a662f132eeb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 13:56:00.675935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59848f1f132f4383b5012a662f132eeb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59848f1f132f4383b5012a662f132eeb. Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:56:00.709158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 13:56:00.712908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application yield resource Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise self.value Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application session.commit() Jul 11 13:56:00.716638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.flush() Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application compat.raise_( Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 13:56:00.729208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 13:56:00.732151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:56:00.734287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [parameters: {'id': '59848f1f132f4383b5012a662f132eeb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.736235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:00.746041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59848f1f132f4383b5012a662f132eeb. Jul 11 13:56:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:00.749140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:00.749140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:00.749140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:00.749140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:00.749725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:00.750050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 470/949] 10.222.0.60 () {60 vars in 1140 bytes} [Mon Jul 11 13:56:00 2022] POST /identity/v3/projects => generated 262 bytes in 360 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:00.750203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:00.750349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:00.761472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:00.763568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:00.765314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 480/950] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:56:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:00.768104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:00.886407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:00.965490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331054-2ac3-43ec-b364-f9777c2cfa9f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:00.983771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94310c-08c2-48a2-85af-61889690ad5c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.011518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.012256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.012526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.012797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.020563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.022327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-20e0fe6d-0705-44d0-96ef-1cfbd2252a3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:56:01.039580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:01.040675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:01.041555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 471/951] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:01.042435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d6e-5602-4b7e-9057-c440da25c3a0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.042745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d6e-5602-4b7e-9057-c440da25c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.043004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d6e-5602-4b7e-9057-c440da25c3a0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.047859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 472/952] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:01.049699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed16e-4afb-4daa-91d5-01f923b1a2dc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.050282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed16e-4afb-4daa-91d5-01f923b1a2dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.050604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed16e-4afb-4daa-91d5-01f923b1a2dc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.052198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 473/953] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:01.053007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed16e-4afb-4daa-91d5-01f923b1a2dc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.056063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.057174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.057698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.058221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.059448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:01.059983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.062467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d3318-1b04-4262-8096-09e145050896 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.077174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 481/954] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:01.077174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0039e-65bf-4b29-b5be-0deb5738d41c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.077174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0039e-65bf-4b29-b5be-0deb5738d41c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.077174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0039e-65bf-4b29-b5be-0deb5738d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.089937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:01.103508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6fc0039e-65bf-4b29-b5be-0deb5738d41c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:01.109957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6fc0039e-65bf-4b29-b5be-0deb5738d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:01.190023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed16e-4afb-4daa-91d5-01f923b1a2dc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.212028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 482/955] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:01.214197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.214623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.215035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.230814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.231763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.232197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.232625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.233618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:01.234090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.235858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.246537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:01.248465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:01.258620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 474/956] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:01.259774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.290967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:01.373534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 483/957] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:01.375674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.399447 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:01.420636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636105ad-90af-4e5c-b513-b2c0946b20a6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.481241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.482622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.483131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.483611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.484945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:01.485496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.488205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.498065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 475/958] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:01.500892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.540174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176f3d1-b60d-4701-8ff8-793ddd2c4d5f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.583182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.584451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.586073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.586696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.600068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:01.610419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:01.611467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:01.612315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:01.613761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 484/959] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:01.614742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.647126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:01.684461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088082f-0acf-4b97-a350-25a8fe2964ab None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.729109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.729958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.730238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.730496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.731249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.732672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:01.746973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:01.749811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:01.751620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 476/960] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:01.752571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.757354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d097-e131-472c-a972-e84ed21364a2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.772521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:01.810056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.810741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.811070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.811320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.812081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.813508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.878688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6871a-8770-4a77-91cc-75d421f062ab None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:01.937686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 485/961] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:56:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:01.937686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:01.968894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:01.970032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:01.970555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:01.971053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:01.972097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:01.972739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:01.974436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:01.986687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 477/962] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:01.996452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:02.088614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:02.123357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ec983-87b0-4353-9b84-3fcc85ad5375 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:02.170803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:02.187705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:02.188790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:02.189103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:02.189384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:02.190149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:02.191921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:02.192538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:02.206301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a0b4-4940-4799-97d9-b4911f6f8e3a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:02.210318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 486/963] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:02.222625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:02.247814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:02.248617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:02.248897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:02.249169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:02.261629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:02.264085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:02.284457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:02.286572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:02.289176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:02.289176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:02.289176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:02.289176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:02.292560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 478/964] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:02.294106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:02.409389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001bf2-6c8c-4229-9242-eb78928e6aa0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:02.442388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:02.448597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1279a25-b2dd-4eca-88b0-9d69ed178ca6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:02.450790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:02.451733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:02.452197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:02.452651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:02.453572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:02.454129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:02.455797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:02.475850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 479/965] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:02.477718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:02.521993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:02.523775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:02.524281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:02.524831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:02.526230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:02.526801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:02.529438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:02.546302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 487/966] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:02.654334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63315a31-d874-40c0-8889-861814d236f2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:02.698389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:02.699653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:02.700209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:02.700703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:02.710750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:02.712780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:56:02.730865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:02.731916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 13:56:02.732876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:02.740535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 480/967] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:56:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:02.742746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:02.754548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:02.929554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dd390-9942-4b98-86be-a745c10c3c2b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:03.002710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:03.003764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.004257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.004754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.006479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:03.007558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:03.010414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:03.047140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 488/968] 10.222.0.60 () {56 vars in 1149 bytes} [Mon Jul 11 13:56:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:03.057165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:03.137495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:03.219324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68394977-ac9b-4cf9-bbd4-d609deec56d5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:03.264092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:03.265156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.265682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.266157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.346540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:03.348408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d980e7-cc2b-4a60-b4cd-0b9614b631b9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:03.402352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:03.467932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 481/969] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:03.477467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:03.584276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:03.644508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156721de-3d7c-48bb-935b-c806e335f37d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:03.702703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:03.704104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.704567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.705134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.706813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173914d-db65-4b36-b736-8635abbfaa9c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.707105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173914d-db65-4b36-b736-8635abbfaa9c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.707388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173914d-db65-4b36-b736-8635abbfaa9c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.709194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 482/970] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:03.714935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.715254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.715505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.725620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:03.728030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:03.734154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:03.735737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:03.762644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:03.763616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:03.764505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:03.764505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:03.764505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:03.764505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:03.773222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 489/971] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:03.774855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:03.829746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 483/972] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:03.852596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:03.942600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520572-90cd-4bce-ae81-35bae082f0c9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:03.964829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:03.978201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:03.987034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:03.987735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:03.988017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:03.988294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:03.989075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:03.989372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:03.991628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.005643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 490/973] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:04.016786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.029096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbb774-5006-4178-ae20-524eeacfba06 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.097536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.098920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.099487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.100570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.102890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.106238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.158933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da087f78-a73c-4799-840a-87797d564f49 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.169022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.sql.core [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 13:56:04.169022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 13:56:04.169022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [parameters: {'user_id': '4d6d0a6aef8448b8a253e57bf95aacab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 13:56:04.169022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 11 13:56:04.185690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:56:04.188250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application yield resource Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise self.value Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application session.commit() Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 13:56:04.191516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.flush() Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application compat.raise_( Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 13:56:04.197859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:56:04.203719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:56:04.212815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [parameters: {'user_id': '4d6d0a6aef8448b8a253e57bf95aacab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:04.217901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 13:56:04.224801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 484/974] 10.222.0.60 () {60 vars in 1131 bytes} [Mon Jul 11 13:56:03 2022] POST /identity/v3/users => generated 160 bytes in 336 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:04.232382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.242821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.242821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.242821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.242821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.251347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.252945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:56:04.274836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:04.276634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:04.279190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:04.281324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 491/975] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:04.282376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.350798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:04.389374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65b73-1746-4f0b-aa67-37179db7e087 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.455757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.457024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.457467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.458040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.465272 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:04.472334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e5a6-bcb2-419e-93ea-74b44d53cd15 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.475737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.478353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4ac55c43-7600-47f2-87b0-954ace0cda82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:56:04.505922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:04.508197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:56:04.510530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:04.513871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 485/976] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:04.516404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210517e-b879-4e18-91b6-14ec3e9bf718 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.519854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210517e-b879-4e18-91b6-14ec3e9bf718 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.519854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210517e-b879-4e18-91b6-14ec3e9bf718 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.528241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 486/977] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:04.528241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210517e-b879-4e18-91b6-14ec3e9bf718 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.542951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.543785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.544010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.544316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.545108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:04.545418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.546961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a48f3-e002-48cc-8385-dfaaeaa3d138 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.562504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 492/978] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:04.563898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.564219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.564507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.586108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:04.588093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:04.696469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210517e-b879-4e18-91b6-14ec3e9bf718 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.718100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 493/979] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:04.720904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.764893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.765608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.765900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.766168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.767692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:04.768108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.769942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.778162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:04.823685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 487/980] 10.222.0.60 () {56 vars in 1101 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:04.825558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:04.923640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd34ee-7c54-4e91-9d6e-c9872d1121ea None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:04.950658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:04.973761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:04.974506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.974793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.975140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.977214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] RBAC: Adding query filter params (role.id=f012170a08bf465e87567cad04e8dacb, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=a4467c612a534ae9871d4a6579e19bb0) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:04.977689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:04.979262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade4f17-bf37-4375-8a35-d3137e6e9566 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:04.989776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 494/981] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/role_assignments?user.id=a4467c612a534ae9871d4a6579e19bb0&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=f012170a08bf465e87567cad04e8dacb => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:04.991749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6994e-9d5f-4e6a-9851-3c12fd3dad76 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:04.992058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6994e-9d5f-4e6a-9851-3c12fd3dad76 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:04.992341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6994e-9d5f-4e6a-9851-3c12fd3dad76 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:04.994165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 495/982] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:05.000171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.000488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.000804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.020671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:05.022130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:05.062973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ecb69-98b8-4786-92a8-043d83a94540 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:05.122005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:05.124134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.124930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.125410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.130001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:05.130635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:05.140068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:05.159383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:05.161431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:05.164405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 488/984] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:56:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:05.171107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:05.177456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:05.208911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:05.338583 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530781-bc2b-41d9-96ed-ce24fffe199e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:05.363284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fa95-ae5e-488f-9883-183f0fae2676 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:05.394824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:05.395309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:05.396028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.396489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.396947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.399798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:05.401876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:05.420995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:05.421766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.422053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.422397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.423115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:05.423417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:05.424821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:05.431031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 489/985] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:05.436942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:05.481056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 497/986] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:56:05 2022] POST /identity/v3/services => generated 242 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:05.577750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ff7c-cd53-4631-bc89-6c506f5b429b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:05.636561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:05.637266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.637544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.637856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.638605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:05.639054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:05.640370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:05.647747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 490/987] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:05.653705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:05.790725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:05.839483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ef74-5cf0-4a10-88ef-a56318a45585 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:05.916919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:05.917772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:05.918061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:05.918486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:05.919759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] RBAC: Adding query filter params (interface=admin, service_id=3b59d42bc09046179db5542d124d5f47, region_id=RegionOne) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:05.920263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:05.923029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9afc-2bca-420d-bc8a-6fa0d169602f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:05.941682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 498/988] 10.222.0.60 () {56 vars in 1249 bytes} [Mon Jul 11 13:56:05 2022] GET /identity/v3/endpoints?service_id=3b59d42bc09046179db5542d124d5f47&interface=admin®ion_id=RegionOne => generated 193 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:05.944732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:06.039263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:06.156662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d73069-4cee-4228-aaad-dbd6fe3d8409 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:06.226931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:06.228107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:06.228603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:06.229089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:06.230416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:06.233070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b7e5-68e8-41c3-ba5c-bdc8fe52b879 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:06.253633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 491/989] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:56:05 2022] GET /identity/v3/services => generated 1727 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 13:56:07.346579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac369a-2eae-4627-9884-f4849a602e09 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.347145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac369a-2eae-4627-9884-f4849a602e09 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.347255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac369a-2eae-4627-9884-f4849a602e09 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.348581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 499/990] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:07.356971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.357480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.357554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.381567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:07.383344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:07.470856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 492/991] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:07.495300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac369a-2eae-4627-9884-f4849a602e09 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:07.658431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac369a-2eae-4627-9884-f4849a602e09 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:07.724643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:07.726058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.726527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.727018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] PATH_INFO: `/v3/services/image` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.728222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:07.730271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e9395eaa-585d-49cf-ab36-9728e72f533e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:07.745014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:07.747221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:07.749283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 500/992] 10.222.0.60 () {56 vars in 1105 bytes} [Mon Jul 11 13:56:07 2022] GET /identity/v3/services/image => generated 86 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:07.753229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:07.762239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5f28-4237-4189-afe9-05ab08e4a0df None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.762757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5f28-4237-4189-afe9-05ab08e4a0df None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.763285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b5f28-4237-4189-afe9-05ab08e4a0df None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.766230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 501/993] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:07.771541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668259-d392-4582-8636-72162f69aa6a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.771953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668259-d392-4582-8636-72162f69aa6a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.773278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668259-d392-4582-8636-72162f69aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.791475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-59668259-d392-4582-8636-72162f69aa6a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:07.792716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-59668259-d392-4582-8636-72162f69aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:07.795332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:07.817758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:07.877008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 502/994] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:07.900635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59668259-d392-4582-8636-72162f69aa6a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:07.913653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b59f6-6512-4441-a0e6-24d9bdd7d727 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:07.966015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:07.967078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:07.967534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:07.967992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:07.969752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] RBAC: Adding query filter params (name=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:07.969752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:07.971527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:07.984873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 493/995] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:07.986200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.042613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59668259-d392-4582-8636-72162f69aa6a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:08.095474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:08.096764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.097308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.097836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.100176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:08.103252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:08.109130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:08.112931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c712-f146-4687-9af6-dc88f906d404 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:08.132358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:08.135000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:08.136831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 503/996] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:08.140581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.144196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:08.171764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:08.172892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.173396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.173913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.175284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:08.175823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:08.178571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:08.193536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 494/997] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:08.286093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc07c6-0e69-4525-9a31-6f71e704b21c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:08.330809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:08.331524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.331813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.332097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.332919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:08.333231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:08.335282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df8b1-8d7f-4d7d-b5cc-08d7e153813a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:08.341674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 504/998] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:08.347488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.516281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b181c1-6a43-4200-b4a1-1afa21aa8dc5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:08.588196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:08.589524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.590072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.590620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.592038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:08.592591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:08.595336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:08.596269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fe49-c460-4b5d-8287-1726617f3662 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.596830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fe49-c460-4b5d-8287-1726617f3662 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.596830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fe49-c460-4b5d-8287-1726617f3662 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.598477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 505/999] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:08.604954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.605246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.605555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.613047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 495/1000] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:08.614858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.626460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:08.628611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:08.670617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:08.723621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:08.733997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 506/1001] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:08.758417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.776442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b165b9-05d2-49f6-880a-527af28f7c0f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:08.834689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:08.835811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:08.836271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:08.836868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:08.838439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] RBAC: Adding query filter params (interface=public, service_id=3df7157a99a44eef8200b29a18bf8b8d, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:08.838969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:08.841378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:08.851615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 496/1002] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:56:08 2022] GET /identity/v3/endpoints?service_id=3df7157a99a44eef8200b29a18bf8b8d&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:08.860797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:08.939205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784054d-6baf-4468-8d42-a3485f4039ad None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:09.004541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:09.012749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:09.014243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:09.014707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:09.015294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:09.016455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:09.026269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:09.026558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d5668-0da5-4fc2-b12e-e227a1bbeb7b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:09.035415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:09.037443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:09.040521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 507/1003] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Jul 11 13:56:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:09.046274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:09.096514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:09.097615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:09.098145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:09.098553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:09.099780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:09.102263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:09.125623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 497/1004] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:56:08 2022] GET /identity/v3/services => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 13:56:09.160991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:09.249508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e823-07ac-493e-988a-05ac0a3c3fc3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:09.307576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:09.308277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:09.308570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:09.308845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:09.309572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:09.309957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:09.311328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:09.320946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 508/1005] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:09.330455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:09.532246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53420e-6401-47d6-acba-c2b6640494ec None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:09.594361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:09.595426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:09.595928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:09.596419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:09.597816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:09.598177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:09.600585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19c82-8bdc-4bc8-a8ca-0f0fb6b9ca1a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:09.608827 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 498/1006] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Jul 11 13:56:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:09.618118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:09.754579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282bc8-a676-4a70-bf3b-b2751ed8daa2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:09.789779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:09.809072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:09.810267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:09.810731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:09.811054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:09.811930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:09.813950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3884a4-4593-4bfd-bd56-7333d890465e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:09.914428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 509/1007] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:56:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:10.434939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd976f-9ce6-4ad7-91a1-9937a8018be5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:10.435310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd976f-9ce6-4ad7-91a1-9937a8018be5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:10.435521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd976f-9ce6-4ad7-91a1-9937a8018be5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:10.437621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 499/1008] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:10.444253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110614d-e482-4d7a-b5dd-e3fcd1adf4db None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:10.444676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110614d-e482-4d7a-b5dd-e3fcd1adf4db None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:10.444880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110614d-e482-4d7a-b5dd-e3fcd1adf4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:10.464112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4110614d-e482-4d7a-b5dd-e3fcd1adf4db None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:10.465359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4110614d-e482-4d7a-b5dd-e3fcd1adf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:10.571857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 510/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:10.607078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd976f-9ce6-4ad7-91a1-9937a8018be5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:10.641968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:10.783774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd976f-9ce6-4ad7-91a1-9937a8018be5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:10.856716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:10.857513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:10.858058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:10.858498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:10.859459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:10.861083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c3e0-7c21-4977-8e93-7023973c7688 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:10.989374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 500/1010] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:56:10 2022] POST /identity/v3/services => generated 242 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:11.332914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca238-e827-4a3a-9048-50563967097a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:11.333464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca238-e827-4a3a-9048-50563967097a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:11.333464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca238-e827-4a3a-9048-50563967097a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:11.335409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 511/1011] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:11.341300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:11.341611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:11.352720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:11.363822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:11.365059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:11.452586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 501/1012] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:11.493242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dca238-e827-4a3a-9048-50563967097a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:11.687026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dca238-e827-4a3a-9048-50563967097a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:11.711777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:11.760187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:11.761934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:11.762570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:11.772338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:11.772338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:11.772338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:11.792762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:11.795317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 13:56:11.798003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:11.803219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 512/1013] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:11.814091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:11.830165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:11.985007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb784f-40d5-4bc3-91bd-7a9547b6b309 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:12.030754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:12.031823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.032313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.032783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.033744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:12.034248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:12.035876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f5290-3374-4cd5-aad5-27c374e657d9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:12.043434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 502/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:12.049660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:12.136064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70946c5-b963-48e7-af74-77eb2e4dfca0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.136333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70946c5-b963-48e7-af74-77eb2e4dfca0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.136612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70946c5-b963-48e7-af74-77eb2e4dfca0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.138054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 503/1015] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:12.152820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.153081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.153445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.172075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:12.173286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:12.194074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eacbdf-8b38-4067-825f-3b1509100617 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:12.241165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:12.243029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.243029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.243029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.243303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:12.243550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:12.244996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:12.251183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 513/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Mon Jul 11 13:56:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:12.260398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:12.266494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:12.272185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 504/1017] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:12.298853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:12.336892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:12.450327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc49af-c080-4ca9-99f5-c42d0c5a849f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:12.460366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282105b3-54dd-44be-96aa-1aae83f5db04 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:12.513665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:12.514388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.514681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.515035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.515356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:12.515803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:12.516735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.517230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.517332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ce95-ba08-41c9-867c-daf1a51ac956 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:12.517758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.519860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:12.523418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:12.529619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 505/1018] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:12.532724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:12.611441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 514/1019] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:56:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:56:12.623995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:12.670237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45ac1-ee58-42db-bfe8-a83bf4268df8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:12.725355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:12.726398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:12.726719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:12.726991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:12.727745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:12.729293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc0ae-b205-4f39-9bda-f3b0e80eeaf3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:12.896307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 506/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:56:12 2022] POST /identity/v3/projects => generated 311 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:56:13.345963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bdaf5-ee13-4113-a0ea-aa43c7aa82af None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:13.346689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bdaf5-ee13-4113-a0ea-aa43c7aa82af None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:13.346689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bdaf5-ee13-4113-a0ea-aa43c7aa82af None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:13.348107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 515/1021] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:13.355775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:13.356353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:13.356802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:13.379891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:13.382301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:13.476326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 507/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:13.499952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bdaf5-ee13-4113-a0ea-aa43c7aa82af None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:13.614371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:13.628231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bdaf5-ee13-4113-a0ea-aa43c7aa82af None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:13.683706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:13.684516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:13.684799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:13.685069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] PATH_INFO: `/v3/services/image` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:13.685796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:13.687207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:13.701956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:13.703946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:13.705539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:13.710787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 516/1023] 10.222.0.60 () {56 vars in 1105 bytes} [Mon Jul 11 13:56:13 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:13.714046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:13.774853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:13.876209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3030b3-e9da-4505-acc9-6f61805a5d8d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:13.932475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:13.933821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:13.933821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:13.933821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:13.934432 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] RBAC: Adding query filter params (name=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:13.934742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:13.936155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:13.949317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 508/1024] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:13.950420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:14.127365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a9b66-ca7c-4e0d-a652-bcb7df183b17 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:14.178287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:14.179379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:14.179798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:14.180209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:14.181328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] RBAC: Adding query filter params (type=image) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:14.181828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:14.184323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:14.194664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 517/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:14.204245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:14.401819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577dc33-6b78-4527-a5d0-162e746bb120 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:14.422575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:14.466841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:14.468000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:14.468502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:14.468998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:14.470581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] RBAC: Adding query filter params (interface=public, service_id=77931e08676749929182e433e6db77c9, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:14.471148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:14.473815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c03cb-ceb5-4d7e-9119-a449a2fc5eb9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:14.489090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 509/1026] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:56:14 2022] GET /identity/v3/endpoints?service_id=77931e08676749929182e433e6db77c9&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:14.491964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:14.538602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:14.700073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a694e-da0b-4749-92cb-06288ea6a497 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:14.767053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:14.768218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:14.768722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:14.769225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:14.770664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:14.773850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf5e5-39b2-42cd-a237-30ae05dfa46b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:14.788751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 518/1027] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:56:14 2022] GET /identity/v3/services => generated 1957 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 13:56:15.294054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f72fe-18df-4659-9d8e-e03a946daf6c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.294851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f72fe-18df-4659-9d8e-e03a946daf6c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.294851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f72fe-18df-4659-9d8e-e03a946daf6c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.296352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 510/1028] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:15.302189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ccd53-c702-4900-a09f-97cd3b211ff4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.302599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ccd53-c702-4900-a09f-97cd3b211ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.302862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ccd53-c702-4900-a09f-97cd3b211ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.323125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e82ccd53-c702-4900-a09f-97cd3b211ff4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:15.324366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e82ccd53-c702-4900-a09f-97cd3b211ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:15.411650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 519/1029] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:15.436632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f72fe-18df-4659-9d8e-e03a946daf6c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:15.458774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a143-7d8b-441d-addf-6607bb9b8e04 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.459805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a143-7d8b-441d-addf-6607bb9b8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.460278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a143-7d8b-441d-addf-6607bb9b8e04 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.463129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 520/1030] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:15.471527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.471793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.472079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.499641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:15.501723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:15.524072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:15.589421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f72fe-18df-4659-9d8e-e03a946daf6c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:15.634050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 521/1031] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:15.654555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:15.656027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.656536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.657068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.679317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:15.680721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:15.695160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:15.697094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:15.699580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 511/1032] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:56:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:15.704693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:15.752663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:15.869070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892456-a3b8-4a13-953e-0cb186f366c2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:15.869762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56ed84-83d7-4632-abe9-c7b1a69d511c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:15.929361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:15.930308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.930593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.931024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.932179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:15.932465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:15.933457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:15.933756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:15.934006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:15.934376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:15.935686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 522/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:15.935878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:15.936185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:15.938620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:15.941827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:15.962443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 512/1034] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:56:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:15.963178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:15.964771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:16.104730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aecd4b-bf14-45a9-894b-6d2666aa8cfd None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:16.120010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:16.131254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0caf9-65d5-40a3-876a-6f5f736834f7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:16.158356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:16.159109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:16.159405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:16.159672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:16.160422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:16.162518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:16.190377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:16.191292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:16.191718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:16.192232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:16.207082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:16.209543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:16.230466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:16.232086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:16.233896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:16.233896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:16.233896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:16.233896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:16.233896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 513/1035] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:16.238125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:16.287077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 523/1036] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:56:15 2022] POST /identity/v3/users => generated 285 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:56:16.377426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a935-e5bd-44cc-ae8b-4d34fda19374 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:16.431486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:16.432209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:16.432524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:16.432833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:16.433650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:16.434598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:16.439050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:16.466290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 514/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:16.472767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:16.579905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:16.639168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e4c63-8f8c-49d6-a3c1-995f018dafb0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:16.704475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:16.705831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:16.706350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:16.706744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:16.721925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:16.724315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:56:16.750814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:16.752416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:16.753454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:16.754168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 524/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:56:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:16.763354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:16.783140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:16.958189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c01ef-be83-459f-a554-589923e0ee77 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:16.998466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:16.999172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:16.999452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:16.999727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.000580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:17.000890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:17.002636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf91e-4401-4ed0-a45a-aaf1c191bc1c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:17.028700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 515/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:56:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:17.030260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:17.159872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de4a7-6c31-4f98-b9b9-e436853fdcb6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:17.215284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:17.226065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:17.226957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:17.227450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:17.227935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.371135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:17.374313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:17.375095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42c8c-5001-4889-a4d0-72903c12868e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:17.375561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42c8c-5001-4889-a4d0-72903c12868e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:17.376029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42c8c-5001-4889-a4d0-72903c12868e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.378459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 516/1040] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:17.387192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:17.387637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:17.388101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.417315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:17.419291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:17.535511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:17.554021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 517/1041] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:17.554318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 525/1042] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:17.559744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:17.572932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:17.613780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:17.714505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc011378-4f60-42d1-ae35-c9a47fbb9bac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:17.731177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b623d0-8db3-4ac6-8284-d01ef6dc38dd None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:17.757458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:17.758311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:17.758599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:17.758878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.770928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:17.773298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:17.793883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:17.794869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:17.795809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:17.795809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:17.795809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:17.795809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:17.795809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 518/1043] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:17.805222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:17.811390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:17.812319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:17.812598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:17.812879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] PATH_INFO: `/v3/services/image` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:17.813537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:17.814974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:17.828198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:17.829331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:17.830350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 526/1044] 10.222.0.60 () {56 vars in 1105 bytes} [Mon Jul 11 13:56:17 2022] GET /identity/v3/services/image => generated 86 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:17.837020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:17.878559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:17.967212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d6f7-ad31-46ea-a0bd-4c38fd4eb906 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.013002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:18.024346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2131d5-f019-4ce3-ae37-cd54cb60a842 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.027656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.028889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.029257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.029706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.030819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:18.031267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.033481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.059701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 519/1045] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:18.061612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.081861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.083001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.083379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.084299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.085356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:18.085785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.087615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.100893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 527/1046] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:18.102503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.219240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0a01-33b8-4cc4-bde1-c74266752bff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.231013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:18.246491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f8dd-4675-4603-8fa5-fc3cc2cfe0f6 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.264634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.266055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.266569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.267065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.281388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.284283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.299612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.300593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.301031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.301524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.303016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] RBAC: Adding query filter params (type=image) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:18.303481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.305063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.311285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 528/1047] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:56:18.318649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:18.319641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:18.320541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:18.320982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 520/1048] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:18.322944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.331539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.370650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:18.514509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c7dd9-831d-4862-be3b-e7e38ca8c787 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.520137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba1e6c-1f2a-48dc-8988-e7af7aec7b86 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.571974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.573067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.573536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.574071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.575356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.577890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8794e-816b-4f62-8fcd-6f6cd0af21cf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.585149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.586118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.587003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.587418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.588555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:18.589004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.590766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.607046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 521/1049] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:18.613329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.649389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:18.670630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 529/1050] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:56:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:18.673563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60048445-7f02-4822-9bce-4553615e2ed1 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.673885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60048445-7f02-4822-9bce-4553615e2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.674173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60048445-7f02-4822-9bce-4553615e2ed1 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.680979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 530/1051] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:18.682920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.683209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.683492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.705342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:18.706708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:18.765761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e309952-0d14-4fa8-9170-0ccb82232d55 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:18.836916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:18.837927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:18.838363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:18.838798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:18.840250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] RBAC: Adding query filter params (role.id=f012170a08bf465e87567cad04e8dacb, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:18.840885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:18.842596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:18.843779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 531/1052] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:18.850850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 522/1053] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:18 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=f012170a08bf465e87567cad04e8dacb => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:18.873146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:18.876552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:19.010003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca37a71-abad-4981-b5d2-5ff516791651 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:19.056487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:19.057632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:19.058095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:19.058374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:19.071881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:19.080102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:19.082029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:19.083769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 532/1054] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:19.087900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:19.232642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:19.248514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477468-8d65-4629-ab4f-aaecc3116936 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:19.292199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:19.292882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:19.293165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:19.293438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:19.294214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:19.294513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:19.295916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:19.306054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 523/1055] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:19.311862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:19.417159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:19.472670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e2a80-eeb0-4202-94f1-ce48378a4c4c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:19.515330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:19.516214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:19.516496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:19.516767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] PATH_INFO: `/v3/users/0849ef8cc79d465ea3a60476d10d251f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:19.534816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] RBAC: Authorizing `identity:get_user(user_id=0849ef8cc79d465ea3a60476d10d251f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:19.536318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:19.538814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 533/1056] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:19 2022] GET /identity/v3/users/0849ef8cc79d465ea3a60476d10d251f => generated 285 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:19.545354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:19.743785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1849-1787-49c5-ad91-aefa71929929 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:19.807195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:19.807871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:19.808154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:19.808426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:19.831078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:19.905852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:19.907939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:20.061014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 524/1057] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 13:56:20.069849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:20.247919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3de8d-74ca-4308-9cf4-6c40dee08e21 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:20.276940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:20.298787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:20.300616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:20.301319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:20.302680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:20.305192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:20.308086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bdec1-a7aa-4d58-953a-ce5e5f68b84e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:20.313066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 534/1058] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:20 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:20.319279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:20.439900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:20.546351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a624f87-3a1d-4d38-a4fd-58fee8a2d71a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:20.631371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:20.633086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:20.633957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:20.634728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:20.636688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=5ee3a42707cc41bc923e97c847a95b57, user.id=0849ef8cc79d465ea3a60476d10d251f) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:20.637646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:20.640679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450a65a-9c8b-4b36-8104-6c90095a34e6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:20.653562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 525/1059] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:20 2022] GET /identity/v3/role_assignments?user.id=0849ef8cc79d465ea3a60476d10d251f&scope.project.id=5ee3a42707cc41bc923e97c847a95b57&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:20.936633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222ebe-bb6a-44b4-b785-a0a1a73b3676 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:20.937010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222ebe-bb6a-44b4-b785-a0a1a73b3676 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:20.937294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222ebe-bb6a-44b4-b785-a0a1a73b3676 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:20.939042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 535/1060] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:20.944970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a9ea-6da9-43c9-b860-3a3d33581fe8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:20.945354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a9ea-6da9-43c9-b860-3a3d33581fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:20.945677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a9ea-6da9-43c9-b860-3a3d33581fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:20.972604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-abf5a9ea-6da9-43c9-b860-3a3d33581fe8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:20.975063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-abf5a9ea-6da9-43c9-b860-3a3d33581fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:21.121650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 526/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:21.140375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652a19-d68b-4213-b1a6-289194b5340b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.140901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652a19-d68b-4213-b1a6-289194b5340b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.141388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652a19-d68b-4213-b1a6-289194b5340b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.144188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 536/1062] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:21.153243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652a19-d68b-4213-b1a6-289194b5340b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:21.153799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.154407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.154764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.179229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:21.180969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:21.231793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:21.272297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 527/1063] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:21.300849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:21.362130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652a19-d68b-4213-b1a6-289194b5340b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:21.411042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:21.412638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.413021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.414130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.461361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd44e88-5516-4383-92b8-a4f642bb6ad8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:21.505031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:21.518072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:21.519777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:21.522152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:21.522152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.522472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.522668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.540627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:21.553295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:21.556377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:21.558141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 528/1064] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:21.561854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:21.606992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:21.659090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 537/1065] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:21.665845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:21.743873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39cea-ef9c-4522-baf1-0915ceb3b100 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:21.785300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:21.790226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:21.791005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.791294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.791576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.792365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:21.792675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:21.794146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:21.801441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b0faa-b5a6-4baf-b32c-5c996cad0b0a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:21.804690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 529/1066] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:21.811389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:21.842201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:21.843138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:21.843427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:21.843703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:21.857137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:21.858736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:21.879155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:21.880691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:21.881722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:21.881722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:21.881722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:21.881722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:21.881722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 538/1067] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:21.887501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:22.007669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df98e-82a4-42b4-a086-33ff076a4c6b None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.010224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:22.024666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c880a-6e54-4e3a-921b-50c8b3693097 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.071080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:22.071968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.072436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.072882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.073861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:22.074458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:22.075672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:22.076478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:22.077920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.078326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.079333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.093789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 539/1068] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:22.104517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:22.107544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:22.145556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:22.147663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 530/1069] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:22.154912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:22.159763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:22.290771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef03e-b08e-4037-b90a-3f3b119c38e4 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.340812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:22.341504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.341824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.342105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.342860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:22.343238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:22.344659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:22.363737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 540/1070] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:22.374893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:22.545276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cae51-926c-4177-8a68-25bc781b0fc8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.586426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:22.587239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.587519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.587792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.596821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:22.598372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:56:22.616633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:22.617819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:22.618794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:22.621781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 531/1071] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:56:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:22.623940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:22.696304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:22.743830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f3f1-37d2-4038-befd-42bb65df57c5 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.788481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:22.789223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.789509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.789815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.790671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:22.790983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:22.792426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6fed1-89c5-4572-82f2-97204a89330b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:22.815750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 541/1072] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:56:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:22.823570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:22.840145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:22.962571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7664ef-2f31-4a51-959e-d1866eba15da None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:22.993831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1408be-9209-4ee5-a6ac-6d3d5324ac03 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:22.994430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1408be-9209-4ee5-a6ac-6d3d5324ac03 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:22.994993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1408be-9209-4ee5-a6ac-6d3d5324ac03 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:22.997654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 542/1073] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:23.004606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.005187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.005563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.008241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.009615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.010098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.010556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.028518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.029055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:23.030357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:23.030593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:23.066743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:23.067738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:23.068668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:23.068668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:23.068668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:23.068668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:23.074104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 532/1074] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:23.076742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.109521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 543/1075] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:23.134838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.157700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.206650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f698b-c6e0-4ffb-9221-e9105570627c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.207694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.248115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.248791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.249067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.249344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.250192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:23.250496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.251921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.266373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e889be-4daf-461e-b445-8e98e97c5c87 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.273239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 533/1076] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:23.282457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.313930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.315386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.315836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.316284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.336086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:23.350747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:23.352011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:23.352887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:23.357804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 544/1077] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:23.362120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.444339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa3b1-493f-4da1-af0a-f38c80baddda None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.470215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.485546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee921-ff83-4b2f-be81-c0bc0c72cf2d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.487852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.487852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.487852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.487852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.495543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.497042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.500939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:56:23.512761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:23.514603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:23.515727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 534/1078] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:23.521533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.539684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.540405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.540675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.540956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.541768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:23.542084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.543682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.554225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 545/1079] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:23.561074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.664255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9eeb-48b3-41c3-bd44-a229111b38d1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.699647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.700311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.700587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.700815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24de79f-b3f4-437f-854f-c0e8d1f26230 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.700912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.701675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:23.701990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.703433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.716297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 535/1080] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:23.722468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.742045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.742714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.743945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.743945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] PATH_INFO: `/v3/users/0849ef8cc79d465ea3a60476d10d251f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.744723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] RBAC: Authorizing `identity:get_user(user_id=0849ef8cc79d465ea3a60476d10d251f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.746154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.753128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 546/1081] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/users/0849ef8cc79d465ea3a60476d10d251f => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:23.754456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:23.799921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.813533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:23.877164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67179-4875-45ff-bbdd-ae65add480ad None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.886883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49743-48c1-4fd9-b1ff-be6a46e60e70 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:23.924074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.924908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.925189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.925470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/f012170a08bf465e87567cad04e8dacb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.928433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=1e0aca394e4f40c38b3f2db655c462f8, role_id=f012170a08bf465e87567cad04e8dacb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.929958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4426e-b083-416b-b13c-cf370849be1d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.940076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:23.940967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:23.941252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:23.941534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:23.943625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:23.945087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:23.947466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 547/1082] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:23 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:23.959322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:24.027444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 536/1083] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:56:23 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/1e0aca394e4f40c38b3f2db655c462f8/roles/f012170a08bf465e87567cad04e8dacb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 13:56:24.131507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36418-d820-4505-bf26-e34f6c83129d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:24.148960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:24.182103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:24.183046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:24.183221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:24.183515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57/users/0849ef8cc79d465ea3a60476d10d251f/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:24.186400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee3a42707cc41bc923e97c847a95b57, user_id=0849ef8cc79d465ea3a60476d10d251f, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:24.188119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46679-f1c9-41f0-aa06-0b6062935ea0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:24.273692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 548/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:56:23 2022] PUT /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57/users/0849ef8cc79d465ea3a60476d10d251f/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 13:56:26.296633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410a370-4c36-4901-8333-a31509cbcc08 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.297379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410a370-4c36-4901-8333-a31509cbcc08 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.297565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410a370-4c36-4901-8333-a31509cbcc08 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.303928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 537/1085] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:26.306898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ea07-ebdb-4198-8f1e-0c63c3d93281 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.307424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ea07-ebdb-4198-8f1e-0c63c3d93281 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.307902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ea07-ebdb-4198-8f1e-0c63c3d93281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.331110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e702ea07-ebdb-4198-8f1e-0c63c3d93281 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:26.332486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e702ea07-ebdb-4198-8f1e-0c63c3d93281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:26.421914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 549/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:26.446624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410a370-4c36-4901-8333-a31509cbcc08 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:26.506679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a535-ab86-47f8-ab3b-41908855531b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.507200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a535-ab86-47f8-ab3b-41908855531b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.507730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a535-ab86-47f8-ab3b-41908855531b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.510467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 550/1087] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:26.517266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.517825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.520084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.551581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:26.551871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:26.581279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:26.585868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410a370-4c36-4901-8333-a31509cbcc08 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:26.626565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:26.627399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.627679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.627950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.641691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:26.651120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:26.652154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:26.653010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 538/1088] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Jul 11 13:56:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:26.658907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:26.684646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 551/1089] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:26.710902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:26.752443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:26.793218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591bd61-595f-49a6-b14f-8490417ad3d8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:26.839746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:26.840562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.840950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.841429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.842480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:26.842928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:26.844594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:26.857747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8058-b8a7-4fdb-86ec-4053bf66a17d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:26.858028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 539/1090] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:56:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:26.866606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:26.898568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:26.901244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:26.902422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:26.902874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:26.903298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:26.921317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:26.935459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:26.937291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:26.938997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 552/1091] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:26.946793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.014677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83fc2-b858-4a22-9c89-cc9e43bbec57 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.107491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.127449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451005d-6d67-4d25-bdaa-b86fcf512c83 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.134079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.135284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.135784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.136366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.156273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.159385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.177921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.177921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.177921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.177921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.178512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:27.178512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.178512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.184543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 553/1092] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:27.190866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:27.193500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:27.194829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:27.194829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:27.194829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:27.194829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:27.194829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 540/1093] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:27.199936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.200163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.329045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.361221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e077-cfc6-4797-99db-7e197dda24e0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.397344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ebc3-1f9c-4181-be2d-901f85d065c2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.407357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.408172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.408544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.412874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.412874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:27.412874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.412874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.433806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 541/1094] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:27.437191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.448520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.449534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.449949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.450291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] PATH_INFO: `/v3/users/0849ef8cc79d465ea3a60476d10d251f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.451706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] RBAC: Authorizing `identity:get_user(user_id=0849ef8cc79d465ea3a60476d10d251f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.453288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.455147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 554/1095] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/users/0849ef8cc79d465ea3a60476d10d251f => generated 285 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:27.461816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.484264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.565832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35c8e-92db-43d9-be43-efb6fbc1a58d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.604676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.605484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.605796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.606077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.608532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.615787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.617282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.618014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806c07-d06f-4128-9894-968c27d3bcdd None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:56:27.634479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:27.635718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:27.637032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 542/1096] 10.222.0.60 () {56 vars in 1093 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:56:27.642028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.678016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.678695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.678980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.679257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.780392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76f35-d93a-4457-b7db-18e7f15d032e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:27.780771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.783411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.814492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.837274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:27.838166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:27.838537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:27.838912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:27.839876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:27.840284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:27.841928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:27.866881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 543/1097] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:27.872632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.936657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:27.937276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 555/1098] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 13:56:27.943556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:27.997916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193cd9-9316-42e7-92c9-ab5c47983bdb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:28.049367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:28.050355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:28.050711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:28.051056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:28.078438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a688-2fb6-430a-a0e0-034b509cf610 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:28.101099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:28.130531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:28.131598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:28.132313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:28.132929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:28.134797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:28.136596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:28.138785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 556/1099] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:28.146138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:28.158403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:28.162474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:28.252400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:28.267524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee9a7-4406-491f-868f-b3d605b809a7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:28.309642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:28.310322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:28.310791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:28.311077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:28.311922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=5ee3a42707cc41bc923e97c847a95b57, user.id=0849ef8cc79d465ea3a60476d10d251f) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:28.312231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:28.313756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:28.321106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 557/1100] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:28 2022] GET /identity/v3/role_assignments?user.id=0849ef8cc79d465ea3a60476d10d251f&scope.project.id=5ee3a42707cc41bc923e97c847a95b57&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:28.332410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 544/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 13:56:28.340788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:28.423048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:28.498898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60438158-832e-443f-8160-6be68adbdbbf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:28.543491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:28.544389 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:28.544670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:28.544949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:28.559253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:28.562203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:56:28.598238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:28.600660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:28.602408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:56:28.602408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:56:28.602408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:56:28.602408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:28.602408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 558/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:28.611224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:28.806460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc30a4-a5f6-4618-970f-ca3034e3a9fe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:28.850345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:28.851038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:28.851315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:28.851589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:28.852334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:28.852637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:28.854109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:28.869147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 545/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:28.875377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:29.065283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fdda-0236-46cc-8fbc-b76690d31f67 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:29.068928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:29.130547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:29.131958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:29.132456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:29.132952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:29.145911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:29.148695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:56:29.176113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:29.177943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:56:29.178988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:29.179431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 559/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:29.188831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:29.219005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:29.379660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264cfd3-2db7-4306-b496-069d109657c8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:29.445834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:29.446939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:29.447423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:29.447859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:29.449495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:29.450066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:29.452853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703b28-81c2-4f7e-9f57-feee5fac676b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:29.477637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 546/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:56:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:29.484923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:29.667324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458a50d-0dbf-43fa-a879-3435edb8c6c1 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:29.711040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:29.711747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:29.712031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:29.712322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:29.713385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] RBAC: Adding query filter params (role.id=f012170a08bf465e87567cad04e8dacb, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=1e0aca394e4f40c38b3f2db655c462f8) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:29.713750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:29.715259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3cc6b-dedb-482b-9b40-4a665bee2334 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:29.722750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 560/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:29 2022] GET /identity/v3/role_assignments?user.id=1e0aca394e4f40c38b3f2db655c462f8&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=f012170a08bf465e87567cad04e8dacb => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:30.873302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b5904-b64d-4f03-85df-601472bd5a00 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:30.873967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b5904-b64d-4f03-85df-601472bd5a00 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:30.873967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b5904-b64d-4f03-85df-601472bd5a00 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:30.875521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 547/1107] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:30.882342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:30.883138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:30.883330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:30.902326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:30.904417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:30.929990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:30.984448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 561/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:31.010369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b5904-b64d-4f03-85df-601472bd5a00 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:31.093113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:31.134838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b5904-b64d-4f03-85df-601472bd5a00 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:31.192728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:31.194121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:31.194626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:31.195123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:31.197259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:31.199766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1113f-9c17-4539-99c0-43e06b3428ba None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:31.202838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 548/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:31.209296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:31.327400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e233ac-fa53-44ef-b072-e02f000a7e4a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:31.367606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:31.368298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:31.368589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:31.368888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:31.369649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:31.371134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0f6b-cb32-47d2-a928-f219973ebbb9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:31.471029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 562/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:56:31 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:33.691558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4fe8d-9800-4e43-84be-aef0943adb5d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:33.692146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4fe8d-9800-4e43-84be-aef0943adb5d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:33.692146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4fe8d-9800-4e43-84be-aef0943adb5d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:33.694128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 549/1111] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:33.700483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:33.701068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:33.701068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:33.719681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:33.720996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:33.731318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:33.804272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 563/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:33.829159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4fe8d-9800-4e43-84be-aef0943adb5d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:33.952709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4fe8d-9800-4e43-84be-aef0943adb5d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:33.996007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:33.996899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:33.997183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:33.997460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] PATH_INFO: `/v3/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:33.999284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] RBAC: Authorizing `identity:get_role(role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:34.000771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:34.002275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 550/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:33 2022] GET /identity/v3/roles/51263ee5485341fa98c78d57f2d235fb => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:34.008683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:34.126582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4dc4-d6e8-4fea-a7a6-29b392eb97dd None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:34.170690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:34.171568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:34.171853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:34.172129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] PATH_INFO: `/v3/users/0237fd2b30d34886ba5e14b628fb343a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:34.186717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:34.189516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] RBAC: Authorizing `identity:get_user(user_id=0237fd2b30d34886ba5e14b628fb343a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:34.191089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:34.193026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 564/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:34 2022] GET /identity/v3/users/0237fd2b30d34886ba5e14b628fb343a => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:34.199428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:34.211856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:34.330875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8bf3-767a-447e-83fc-0648107fef9d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:34.376721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:34.377394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:34.377710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:34.377990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:34.463155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:34.464691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:34.476617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:34.592778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 551/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:34.599593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:34.758587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a03710-2176-4993-bc09-f271d44c7d83 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:34.801886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:34.803502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:34.803826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:34.804107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:34.805719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:34.807372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901d9a9-d5dc-4554-a39e-3d0d9998f6d2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:34.809187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 565/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:34 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:34.815783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:34.944392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0886-b893-41ea-9c58-a7da39b6f4e7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:34.957280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:34.988461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:34.990074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:34.990405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:34.990716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:34.991643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=5ee3a42707cc41bc923e97c847a95b57, user.id=0237fd2b30d34886ba5e14b628fb343a) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:34.992003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:34.993797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fcf3-2ebc-4803-9ed3-a39d234e7f6a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:35.000377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 552/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:34 2022] GET /identity/v3/role_assignments?user.id=0237fd2b30d34886ba5e14b628fb343a&scope.project.id=5ee3a42707cc41bc923e97c847a95b57&role.id=51263ee5485341fa98c78d57f2d235fb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:37.154239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125254-d12c-4785-a16b-40e0c43f394f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:37.154898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125254-d12c-4785-a16b-40e0c43f394f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:37.154898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125254-d12c-4785-a16b-40e0c43f394f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:37.156341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 566/1118] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:37.166551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:37.167083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:37.167543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:37.195819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:37.197998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:37.328307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 553/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:37.352469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125254-d12c-4785-a16b-40e0c43f394f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:37.433303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:37.474033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125254-d12c-4785-a16b-40e0c43f394f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:37.515772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:37.516637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:37.516923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:37.517203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] PATH_INFO: `/v3/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:37.518862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] RBAC: Authorizing `identity:get_role(role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:37.520407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:37.521983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 567/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:37 2022] GET /identity/v3/roles/51263ee5485341fa98c78d57f2d235fb => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:37.528117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:37.647133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c998c3-4d72-44c2-bd25-d70d943a9c2c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:37.648936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:37.686343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:37.687132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:37.687407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:37.687678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] PATH_INFO: `/v3/users/0237fd2b30d34886ba5e14b628fb343a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:37.688904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] RBAC: Authorizing `identity:get_user(user_id=0237fd2b30d34886ba5e14b628fb343a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:37.690393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:37.692507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 554/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:37 2022] GET /identity/v3/users/0237fd2b30d34886ba5e14b628fb343a => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:37.701603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:37.820227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309b8b-620d-4b89-95a7-097a6233a532 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:37.862243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:37.863101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:37.863378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:37.864927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:37.866391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:37.867855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dac4c-66c4-4224-9324-b68b679c3f6d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:37.869729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 568/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:37 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:37.876050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:38.014914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca3dd-279c-478b-b465-3a553bbc1edc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:38.058204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:38.059254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:38.059672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:38.060026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57/users/0237fd2b30d34886ba5e14b628fb343a/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:38.062610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee3a42707cc41bc923e97c847a95b57, user_id=0237fd2b30d34886ba5e14b628fb343a, role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:38.064166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b79906-0f4c-491a-b290-b16a3e0458ca None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:38.173118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 555/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:56:37 2022] PUT /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57/users/0237fd2b30d34886ba5e14b628fb343a/roles/51263ee5485341fa98c78d57f2d235fb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:56:40.360438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc40c-274e-408d-9a4a-0226df13f3da None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:40.361029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc40c-274e-408d-9a4a-0226df13f3da None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:40.361029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc40c-274e-408d-9a4a-0226df13f3da None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:40.362589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 569/1124] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:40.369003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:40.369570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:40.369570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:40.388205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:40.389493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:40.418973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:40.468492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 556/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:40.493692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc40c-274e-408d-9a4a-0226df13f3da None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:40.498173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:40.637337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc40c-274e-408d-9a4a-0226df13f3da None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:40.700662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:40.702100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:40.702507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:40.702929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] PATH_INFO: `/v3/roles/51263ee5485341fa98c78d57f2d235fb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:40.705356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] RBAC: Authorizing `identity:get_role(role_id=51263ee5485341fa98c78d57f2d235fb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:40.708577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:40.711270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 570/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:40 2022] GET /identity/v3/roles/51263ee5485341fa98c78d57f2d235fb => generated 223 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:40.717452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:40.830684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed449ea-2e21-44d5-b54f-284400536d9b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:40.870133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:40.871032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:40.871320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:40.871600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] PATH_INFO: `/v3/users/0237fd2b30d34886ba5e14b628fb343a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:40.872885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] RBAC: Authorizing `identity:get_user(user_id=0237fd2b30d34886ba5e14b628fb343a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:40.874465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:40.876178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 557/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:40 2022] GET /identity/v3/users/0237fd2b30d34886ba5e14b628fb343a => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:40.882530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:40.973724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:41.009912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042b5f-7466-4295-bb5e-ba8539c4de9d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:41.068350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:41.069513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:41.070071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:41.070579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:41.209864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:41.212690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:41.310468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:41.344607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 571/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 13:56:41.351064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:41.382629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:41.467559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b4c3-caa8-4597-9714-7676512b2340 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:41.511748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:41.512624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:41.512906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:41.513216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] PATH_INFO: `/v3/projects/5ee3a42707cc41bc923e97c847a95b57` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:41.514516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] RBAC: Authorizing `identity:get_project(project_id=5ee3a42707cc41bc923e97c847a95b57)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:41.516068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2138b-9693-4314-a21e-d0795a35e3ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:41.517917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 558/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:41 2022] GET /identity/v3/projects/5ee3a42707cc41bc923e97c847a95b57 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:41.525774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:41.643619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9531-d853-4f03-aa6a-e88f86a9df1e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:41.686796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:41.687486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:41.687772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:41.688050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:41.688912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] RBAC: Adding query filter params (role.id=51263ee5485341fa98c78d57f2d235fb, scope.project.id=5ee3a42707cc41bc923e97c847a95b57, user.id=0237fd2b30d34886ba5e14b628fb343a) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:41.689228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:41.690765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398803b6-df80-404f-b7db-f27c56c9844b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:41.698325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 572/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:41 2022] GET /identity/v3/role_assignments?user.id=0237fd2b30d34886ba5e14b628fb343a&scope.project.id=5ee3a42707cc41bc923e97c847a95b57&role.id=51263ee5485341fa98c78d57f2d235fb => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:43.936617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528985d3-1be3-4b75-adaa-cbfeede33cd9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:43.937209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528985d3-1be3-4b75-adaa-cbfeede33cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:43.937209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528985d3-1be3-4b75-adaa-cbfeede33cd9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:43.938611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 559/1131] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:43.945710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:43.946541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:43.946729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:43.974874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:43.976956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:44.015495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:44.063278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 573/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:44.089520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528985d3-1be3-4b75-adaa-cbfeede33cd9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:44.230680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:44.237631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528985d3-1be3-4b75-adaa-cbfeede33cd9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:44.276034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:44.276842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:44.277121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:44.277390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:44.278696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:44.280166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c39f-695e-40e3-8985-46b900b1ca80 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:44.281912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 560/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:44.288861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:44.396833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d55c-f41e-4657-a83a-70a443c0126c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:44.434480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:44.435145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:44.435428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:44.435767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:44.436426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:44.437932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3fbf6-63d5-490e-aa0f-a4c5ca738741 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:44.615328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 574/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:56:44 2022] POST /identity/v3/projects => generated 311 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:46.791106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda373fc-afdf-4146-81da-b8f2bf7d7930 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:46.791698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda373fc-afdf-4146-81da-b8f2bf7d7930 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:46.791698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda373fc-afdf-4146-81da-b8f2bf7d7930 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:46.793193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 561/1135] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:46.802576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:46.803506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:46.803506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:46.822825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:46.824048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:46.840472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:46.907325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 575/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:46.934040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda373fc-afdf-4146-81da-b8f2bf7d7930 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:47.057146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda373fc-afdf-4146-81da-b8f2bf7d7930 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:47.098115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:47.099068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:47.099350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:47.099621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:47.100947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:47.102443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d31cc-df91-4ff5-94fd-6c2fc7218c38 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:47.104162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 562/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:47.112239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:47.233257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d9e38-2148-43af-87b6-67a1022ec918 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:47.273540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:47.274254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:47.274537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:47.274811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:47.275532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:47.277006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12e8c-671f-4286-bb7a-f8bf35a9c20c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:47.413463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 576/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:56:47 2022] POST /identity/v3/users => generated 286 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:56:49.700103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4877b-9469-4061-b04a-be86b32565da None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:49.700670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4877b-9469-4061-b04a-be86b32565da None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:49.700670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4877b-9469-4061-b04a-be86b32565da None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:49.702175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 563/1139] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:49.708877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:49.709420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:49.709715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:49.717208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:49.730304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:49.733490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:49.813825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 577/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:49.838625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4877b-9469-4061-b04a-be86b32565da None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:49.876532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:49.963809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4877b-9469-4061-b04a-be86b32565da None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:50.002871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:50.004241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:50.004518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:50.004794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:50.016949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:50.027130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:50.028920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:50.029956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 564/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:50.035169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:50.146453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03631baa-f8de-4950-8b9f-9f3335e76b5e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:50.183379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:50.184059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:50.184343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:50.184619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:50.185376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:50.185726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:50.187122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:50.188718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:50.197697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 578/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:50.203747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:50.303428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:50.312400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261350b-fe23-4490-b5c9-b3b189cdc3cf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:50.349259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:50.350209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:50.350493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:50.350771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] PATH_INFO: `/v3/users/c4d04889e3df4d0e816f4d2384e79433` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:50.368147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d04889e3df4d0e816f4d2384e79433)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:50.369689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:50.371612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 565/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:50 2022] GET /identity/v3/users/c4d04889e3df4d0e816f4d2384e79433 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:50.377767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:50.507951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59659-3352-44a5-9bd9-5713a52211d3 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:50.544722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:50.545381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:50.545721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:50.546021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:50.617689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:50.624838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:50.626480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:50.738028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 579/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:50.744635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:50.854199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4287d29-bbce-4919-a1dd-c028c0c9fda1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:50.893223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:50.894086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:50.894416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:50.894773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] PATH_INFO: `/v3/projects/0d37c8b3cff3462ebc5864fcfda58904` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:50.896355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] RBAC: Authorizing `identity:get_project(project_id=0d37c8b3cff3462ebc5864fcfda58904)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:50.897905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464c48-1fd1-4b11-bdc3-d4d3118868ec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:50.899708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 566/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:50 2022] GET /identity/v3/projects/0d37c8b3cff3462ebc5864fcfda58904 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:50.907195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:51.053233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:51.059947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6415-ed86-4c4e-9105-20c4f5ed4b82 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:51.096799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:51.097677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:51.098077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:51.098363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:51.099208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=0d37c8b3cff3462ebc5864fcfda58904, user.id=c4d04889e3df4d0e816f4d2384e79433) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:51.099522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:51.101160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba2ce1-a2bf-47c9-933f-c46ba6005f97 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:51.108264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 580/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:50 2022] GET /identity/v3/role_assignments?user.id=c4d04889e3df4d0e816f4d2384e79433&scope.project.id=0d37c8b3cff3462ebc5864fcfda58904&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:53.192738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac001-9c3b-4e78-b895-8c464215ab39 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:53.193255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac001-9c3b-4e78-b895-8c464215ab39 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:53.193255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac001-9c3b-4e78-b895-8c464215ab39 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:53.194748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 567/1147] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:56:53.200680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:53.201226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:53.201226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:53.218453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:53.219679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:53.296062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 581/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:56:53.321283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ac001-9c3b-4e78-b895-8c464215ab39 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:53.341046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:53.445966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ac001-9c3b-4e78-b895-8c464215ab39 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:53.507259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:53.508091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:53.508405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:53.508680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:53.520483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:53.528395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:53.529535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:56:53.530453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 568/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:53.536882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:53.639442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:53.650788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc75787-0096-4ef5-a25a-515d5b26e1ce None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:53.689668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:53.690388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:53.690953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:53.691088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:53.691886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:53.692223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:53.693736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:53.703859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 582/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:53.710585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:53.815345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:53.851997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d5d7-63b2-4d68-ac94-00adc0b96df3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:53.891877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:53.892775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:53.893061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:53.893341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] PATH_INFO: `/v3/users/c4d04889e3df4d0e816f4d2384e79433` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:53.895138 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] RBAC: Authorizing `identity:get_user(user_id=c4d04889e3df4d0e816f4d2384e79433)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:53.896597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:53.898314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 569/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:53 2022] GET /identity/v3/users/c4d04889e3df4d0e816f4d2384e79433 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:53.904744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:54.017222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec2fa-f66e-401d-948e-907ce62c8c5c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:54.053217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:54.054119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:54.054399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:54.054670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] PATH_INFO: `/v3/projects/0d37c8b3cff3462ebc5864fcfda58904` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:54.055895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] RBAC: Authorizing `identity:get_project(project_id=0d37c8b3cff3462ebc5864fcfda58904)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:54.057340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579cbb-b728-4fd6-84b4-f60e13bd7435 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:54.059090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 583/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:53 2022] GET /identity/v3/projects/0d37c8b3cff3462ebc5864fcfda58904 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:54.066358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:54.185412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d8-9a41-435f-a49d-5fbe296803ba None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:54.221439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:54.222437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:54.222718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:54.222987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] PATH_INFO: `/v3/projects/0d37c8b3cff3462ebc5864fcfda58904/users/c4d04889e3df4d0e816f4d2384e79433/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:54.225041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] RBAC: Authorizing `identity:create_grant(project_id=0d37c8b3cff3462ebc5864fcfda58904, user_id=c4d04889e3df4d0e816f4d2384e79433, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:54.226601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe68b5-ff6b-41f5-baf1-049b059ce8be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:54.353266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 570/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:56:54 2022] PUT /identity/v3/projects/0d37c8b3cff3462ebc5864fcfda58904/users/c4d04889e3df4d0e816f4d2384e79433/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:56:56.475075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e378e5-c8b0-437c-9db7-35f8e904d00d None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:56.475616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e378e5-c8b0-437c-9db7-35f8e904d00d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:56.475616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e378e5-c8b0-437c-9db7-35f8e904d00d None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:56.477151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 584/1154] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:56:56.482892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:56.483384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:56.483493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:56.496551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:56.502396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:56:56.511845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:56:56.586394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 571/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:56:56.613610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e378e5-c8b0-437c-9db7-35f8e904d00d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:56.654625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:56.808072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e378e5-c8b0-437c-9db7-35f8e904d00d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:56.874451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:56.875914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:56.876432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:56.876981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:56.893045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:56:56.901835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:56:56.903045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:56:56.903894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 585/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:56:56.910009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:57.056977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444667f-084b-4153-a8da-cdf60e7dc64c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:57.114738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:57.116187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:57.116187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:57.116187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:57.116841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:57.117143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:57.118732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:57.121614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:57.130281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 572/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:56:57.136485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:57.233343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:57.255610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e267-20b5-401e-89cc-dd91fbdab9b4 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:57.292713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:57.293608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:57.293891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:57.294233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] PATH_INFO: `/v3/users/c4d04889e3df4d0e816f4d2384e79433` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:57.295530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] RBAC: Authorizing `identity:get_user(user_id=c4d04889e3df4d0e816f4d2384e79433)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:57.296968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:57.298715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 586/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:56:57 2022] GET /identity/v3/users/c4d04889e3df4d0e816f4d2384e79433 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:57.305470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:57.420831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27743abe-c921-480a-8bc8-517ab54fbb3f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:57.458263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:57.459013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:57.459339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:57.459662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:57.537360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:57.541542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:57.543031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:57.665465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 573/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:56:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:56:57.671923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:57.781775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f5c5e-77f7-444b-a1b2-13b6678250ff None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:57.818646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:57.819509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:57.819791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:57.820068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] PATH_INFO: `/v3/projects/0d37c8b3cff3462ebc5864fcfda58904` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:57.821304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] RBAC: Authorizing `identity:get_project(project_id=0d37c8b3cff3462ebc5864fcfda58904)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:57.822791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679ab1-5822-4fac-abbd-eb8681e4e686 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:57.824489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 587/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:56:57 2022] GET /identity/v3/projects/0d37c8b3cff3462ebc5864fcfda58904 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:56:57.834531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:56:57.951178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:56:57.958752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9fb9-9d9b-411b-ab4c-48a9b3e765a3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:56:58.023812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:56:58.024955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:56:58.025438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:56:58.025974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:56:58.027577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=0d37c8b3cff3462ebc5864fcfda58904, user.id=c4d04889e3df4d0e816f4d2384e79433) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:56:58.028152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:56:58.030962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984e01-b851-4b76-b085-fb7864a96e6b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:56:58.042688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 574/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:56:57 2022] GET /identity/v3/role_assignments?user.id=c4d04889e3df4d0e816f4d2384e79433&scope.project.id=0d37c8b3cff3462ebc5864fcfda58904&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:00.182433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb021d3-88ae-46fc-9299-01752ea7986a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:00.182973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb021d3-88ae-46fc-9299-01752ea7986a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:00.182973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb021d3-88ae-46fc-9299-01752ea7986a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:00.184296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 588/1162] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:00.190893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:00.191482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:00.191715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:00.211708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:00.212933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:00.292585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 575/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:00.316500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb021d3-88ae-46fc-9299-01752ea7986a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:00.338112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:00.435462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb021d3-88ae-46fc-9299-01752ea7986a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:00.473607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:00.474304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:00.474591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:00.474872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:00.552892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:00.554393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:00.575845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:00.670944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 589/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:57:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:57:00.677843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:00.783349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:00.794070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8603-752d-4be7-885f-4565ad12287d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:00.835521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:00.836344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:00.836626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:00.836900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:00.844836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:00.846618 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-74ac104c-9a2f-4690-84da-dc766e4030d8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:57:00.864003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:57:00.865829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:57:00.866733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 576/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:57:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:57:00.873348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:00.991425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb01c-c97d-4743-9093-f7cfcef6ca40 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:01.012454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:01.032997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:01.034179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:01.034179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:01.034503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:01.035010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:01.035316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:01.036707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474caf-2131-42d9-a563-d91bed72b214 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:01.046334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 590/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Mon Jul 11 13:57:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:03.191808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ed6-3327-4e19-85ff-dd0a66be607f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:03.192328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ed6-3327-4e19-85ff-dd0a66be607f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:03.192678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ed6-3327-4e19-85ff-dd0a66be607f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:03.195307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 577/1167] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:03.201269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88371a-dbf9-48af-a86f-5feaa1d8ad32 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:03.201853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88371a-dbf9-48af-a86f-5feaa1d8ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:03.201853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88371a-dbf9-48af-a86f-5feaa1d8ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:03.219771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-de88371a-dbf9-48af-a86f-5feaa1d8ad32 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:03.221018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-de88371a-dbf9-48af-a86f-5feaa1d8ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:03.302628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 591/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:03.326213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91ed6-3327-4e19-85ff-dd0a66be607f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:03.444079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91ed6-3327-4e19-85ff-dd0a66be607f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:03.482650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:03.483333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:03.483620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:03.484011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:03.484668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:03.486122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573a679-2df7-44d4-b48c-74129d0650f6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:03.577227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 578/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Mon Jul 11 13:57:03 2022] POST /identity/v3/domains => generated 267 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:57:05.761887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050c4ac-b0fd-4585-b656-505be3b7ab0c None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:05.762540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050c4ac-b0fd-4585-b656-505be3b7ab0c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:05.762540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050c4ac-b0fd-4585-b656-505be3b7ab0c None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:05.763956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 592/1170] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:05.770848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:05.771463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:05.771463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:05.790016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:05.791270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:05.801802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:05.871826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 579/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:05.896914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050c4ac-b0fd-4585-b656-505be3b7ab0c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:06.019858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050c4ac-b0fd-4585-b656-505be3b7ab0c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:06.033336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:06.060904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:06.061830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:06.062118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:06.062434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] PATH_INFO: `/v3/domains/71957b9e29d3428da074fabbe25372c0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:06.075505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=71957b9e29d3428da074fabbe25372c0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:06.077075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c702b31-d30f-403a-babb-f5c030581113 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:06.078943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 593/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Mon Jul 11 13:57:05 2022] GET /identity/v3/domains/71957b9e29d3428da074fabbe25372c0 => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:06.085344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:06.204399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b486078-3a27-4315-afd1-ee3ae3ac3363 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:06.243990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:06.244657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:06.244937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:06.245211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:06.245949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:06.247411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4e639-2b56-4c26-8a11-2ef468745576 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:06.261797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:06.429453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 580/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:57:06 2022] POST /identity/v3/projects => generated 361 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:57:08.703273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48668f-d878-40c9-bc38-61d68b7cb6af None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:08.703886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48668f-d878-40c9-bc38-61d68b7cb6af None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:08.703886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48668f-d878-40c9-bc38-61d68b7cb6af None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:08.706426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 594/1174] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:08.712092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:08.712711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:08.712711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:08.730688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:08.731951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:08.810068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 581/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:08.844841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48668f-d878-40c9-bc38-61d68b7cb6af None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:08.980745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48668f-d878-40c9-bc38-61d68b7cb6af None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:09.019733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:09.020625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:09.020912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:09.021191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] PATH_INFO: `/v3/domains/71957b9e29d3428da074fabbe25372c0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:09.022551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=71957b9e29d3428da074fabbe25372c0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:09.024020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163652e8-f390-4551-8972-6e179ea1bd20 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:09.025741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 595/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Mon Jul 11 13:57:08 2022] GET /identity/v3/domains/71957b9e29d3428da074fabbe25372c0 => generated 267 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:09.032331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:09.150106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9dded-b2b8-4e26-a8fe-119ebc404f4d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:09.179927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:09.191974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:09.193481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:09.193481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:09.193481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:09.194362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:09.195989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad970d-3719-4d69-b8b1-f5f8b1e2f120 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:09.325970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 582/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:57:09 2022] POST /identity/v3/users => generated 311 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:57:11.552014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13932-6c85-46f4-96cf-23556841ce1b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:11.552584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13932-6c85-46f4-96cf-23556841ce1b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:11.552584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13932-6c85-46f4-96cf-23556841ce1b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:11.553970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 596/1178] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:11.559593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:11.560090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:11.560200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:11.578525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:11.579732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:11.655284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 583/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:11.679422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13932-6c85-46f4-96cf-23556841ce1b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:11.727725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:11.804515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13932-6c85-46f4-96cf-23556841ce1b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:11.867460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:11.868888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:11.869405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:11.869935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:11.891411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:57:11.906969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:57:11.908215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:11.909499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:57:11.910487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 597/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:57:11.916306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:12.035342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafc5f9-6efa-4b91-a70e-721ffbb837f8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:12.057320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:12.100202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:12.101350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:12.101895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:12.102445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:12.103662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:12.104214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:12.106542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:12.120462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 584/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:12.126722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:12.245774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:12.250305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1acec7-b8f0-4aea-bc83-1a9a693cbede None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:12.290741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:12.291629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:12.291914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:12.292192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] PATH_INFO: `/v3/users/2b6a7c91bec64b80a81843b9d30e0d29` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:12.307652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] RBAC: Authorizing `identity:get_user(user_id=2b6a7c91bec64b80a81843b9d30e0d29)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:12.309041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:12.310944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 598/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:57:12 2022] GET /identity/v3/users/2b6a7c91bec64b80a81843b9d30e0d29 => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:12.317784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:12.434205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ac67b-9594-4cb7-a07d-073e352f5b3e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:12.476823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:12.477491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:12.477843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:12.478130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:12.527415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:12.558257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:12.559729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:12.681184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 585/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:57:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:57:12.687625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:12.810816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ad01-3dc8-45f9-9337-9003bc4b55ea None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:12.852764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:12.853683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:12.853976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:12.854259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] PATH_INFO: `/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:12.855641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] RBAC: Authorizing `identity:get_project(project_id=0ad9f40b640f40e9b0a3d409fb0b8c5c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:12.857157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f421288-08b0-44de-b9b4-6f945c4a300b None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:12.859036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 599/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:57:12 2022] GET /identity/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:12.866707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:12.952804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:12.989896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e174-cd3d-48d3-bbdd-9fa31bb7a06a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:13.031518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:13.032202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:13.032487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:13.032786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:13.034289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=0ad9f40b640f40e9b0a3d409fb0b8c5c, user.id=2b6a7c91bec64b80a81843b9d30e0d29) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:13.034604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:13.036115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6b4a-05bf-41d1-b2f3-52a8c67b2e3e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:13.042768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 586/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:57:12 2022] GET /identity/v3/role_assignments?user.id=2b6a7c91bec64b80a81843b9d30e0d29&scope.project.id=0ad9f40b640f40e9b0a3d409fb0b8c5c&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:57:15.180363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943eb-2907-438b-9e07-0e17aa3d3d46 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:15.180888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943eb-2907-438b-9e07-0e17aa3d3d46 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:15.180888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943eb-2907-438b-9e07-0e17aa3d3d46 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:15.182274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 600/1186] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:15.188394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:15.189013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:15.189013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:15.207484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:15.208821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:15.288022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 587/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:15.311910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667943eb-2907-438b-9e07-0e17aa3d3d46 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:15.344033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:15.429981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667943eb-2907-438b-9e07-0e17aa3d3d46 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:15.469660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:15.470902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:15.471230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:15.471557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:15.484298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:57:15.493164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:57:15.495158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:57:15.496873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 601/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:57:15.501159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:15.575525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:15.631751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caefc9-b31f-4997-8fd3-87235eac7265 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:15.674028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:15.674717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:15.674996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:15.675267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:15.676027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:15.676329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:15.677746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:15.687071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 588/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:57:15.694342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:15.844326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:15.873101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083724-a23d-4a0e-bab8-8f5f9e98e7ec None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:15.936995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:15.938559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:15.939600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:15.940105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] PATH_INFO: `/v3/users/2b6a7c91bec64b80a81843b9d30e0d29` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:15.942416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] RBAC: Authorizing `identity:get_user(user_id=2b6a7c91bec64b80a81843b9d30e0d29)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:15.944904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:15.947965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 602/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:57:15 2022] GET /identity/v3/users/2b6a7c91bec64b80a81843b9d30e0d29 => generated 311 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:15.954535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:16.069879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e9a6-88f1-4f91-9ade-6931b6e7c14d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:16.099084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:16.107462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:16.108355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:16.109079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:16.109079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] PATH_INFO: `/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:16.110208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad9f40b640f40e9b0a3d409fb0b8c5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:16.111811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8b68e-7ae3-453f-97f3-150aab893081 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:16.113967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 589/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:57:15 2022] GET /identity/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:16.120731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:16.233185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47d99-0197-42ea-b185-c97a3536dba0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:16.274662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:16.275568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:16.275852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:16.276127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] PATH_INFO: `/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c/users/2b6a7c91bec64b80a81843b9d30e0d29/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:16.278286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad9f40b640f40e9b0a3d409fb0b8c5c, user_id=2b6a7c91bec64b80a81843b9d30e0d29, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:16.279751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c361c-c780-4588-99f2-471566706ac0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:16.377385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 603/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:57:16 2022] PUT /identity/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c/users/2b6a7c91bec64b80a81843b9d30e0d29/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:57:18.525150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94607a-6c32-4ace-92ed-9b54e8d7b494 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:18.525750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94607a-6c32-4ace-92ed-9b54e8d7b494 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:18.525750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94607a-6c32-4ace-92ed-9b54e8d7b494 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:18.527223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 590/1193] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:57:18.533848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:18.534564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:18.534564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:18.552654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:57:18.553980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:57:18.563070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:18.632792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 604/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:57:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:57:18.659187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94607a-6c32-4ace-92ed-9b54e8d7b494 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:18.788879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94607a-6c32-4ace-92ed-9b54e8d7b494 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:18.828675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:18.829616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:18.830383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:18.830383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:18.843469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:57:18.851280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:57:18.852553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:57:18.853621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 591/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:57:18.858851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:18.975331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55083-4d2e-41a9-b56c-06c40d77dc5b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:19.022550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:19.023240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:19.023526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:19.023804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:19.024616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:19.024925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:19.026423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:19.037013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 605/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:19.044699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:19.109927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:19.172524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209231d-d509-4bbf-a503-b6e440f317af None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:19.211767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:19.212657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:19.212942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:19.213219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] PATH_INFO: `/v3/users/2b6a7c91bec64b80a81843b9d30e0d29` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:19.214566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] RBAC: Authorizing `identity:get_user(user_id=2b6a7c91bec64b80a81843b9d30e0d29)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:19.216027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:19.217776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 592/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Mon Jul 11 13:57:19 2022] GET /identity/v3/users/2b6a7c91bec64b80a81843b9d30e0d29 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:57:19.225052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:19.229008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:19.341178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59469ca5-22dc-4596-8745-0bfc54cf238e None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:19.381319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:19.382021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:19.382312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:19.382592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:19.463470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:19.464952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:19.468139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:19.582629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 606/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:57:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 13:57:19.589555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:19.709944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0255f0-793f-4a4c-b55b-2888a11aa66c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:19.737854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:19.749728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] PATH_INFO: `/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] RBAC: Authorizing `identity:get_project(project_id=0ad9f40b640f40e9b0a3d409fb0b8c5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b30319-5b72-4ec3-a3ec-e4d912da691d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:19.761117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 593/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Mon Jul 11 13:57:19 2022] GET /identity/v3/projects/0ad9f40b640f40e9b0a3d409fb0b8c5c => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:19.763907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:57:19.898397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c5232-40d9-43c8-a687-2004e64b0ec9 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:57:19.901338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:19.944178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:57:19.944846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:57:19.945132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:57:19.945412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:57:19.946368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=0ad9f40b640f40e9b0a3d409fb0b8c5c, user.id=2b6a7c91bec64b80a81843b9d30e0d29) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:57:19.946683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:57:19.948164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2f98-607e-4909-ae31-edb15de1de42 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:57:19.956017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 607/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:57:19 2022] GET /identity/v3/role_assignments?user.id=2b6a7c91bec64b80a81843b9d30e0d29&scope.project.id=0ad9f40b640f40e9b0a3d409fb0b8c5c&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:57:29.791690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:57:29.951907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=16 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:46.068859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16d35-2787-496b-8e47-b8ab5bd0eafc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:46.069450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16d35-2787-496b-8e47-b8ab5bd0eafc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:46.069450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16d35-2787-496b-8e47-b8ab5bd0eafc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:46.070897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 594/1201] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:46.077698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:46.078251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:46.078251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:46.097777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:46.099107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:46.196959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 608/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:58:46.223718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16d35-2787-496b-8e47-b8ab5bd0eafc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:46.353044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16d35-2787-496b-8e47-b8ab5bd0eafc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:46.390127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:46.390933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:46.391209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:46.391482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:46.402782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:46.405486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:46.426628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:46.427864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:46.429252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:46.429252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:46.429252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:46.429252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:46.429252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 595/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:46.435349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:46.548138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7a04-2728-4675-8543-684e6a73d815 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:46.579295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:46.585228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:46.585934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:46.586222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:46.586502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:46.587238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:46.587536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:46.588914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f60f3-e57f-4b56-b41c-8e7e4679d0b3 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:46.601876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 609/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:46.608257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:46.664981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:46.717437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79c1d-f09e-481d-83f5-7d64512ed3b7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:46.757272 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:46.757998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:46.758282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:46.758558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:46.759507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:46.760989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf01d3-16c6-4e38-b4e6-16f32d072127 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:47.026531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 596/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Mon Jul 11 13:58:46 2022] POST /identity/v3/users => generated 251 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:49.182233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c6f0-eb11-41e4-96e8-639bdaf500cc None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.182763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c6f0-eb11-41e4-96e8-639bdaf500cc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.182763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c6f0-eb11-41e4-96e8-639bdaf500cc None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.184056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 610/1206] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:49.190198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.190698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.190816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.209183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:49.210398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:49.281645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 597/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:58:49.306279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327c6f0-eb11-41e4-96e8-639bdaf500cc None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.416219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327c6f0-eb11-41e4-96e8-639bdaf500cc None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.452361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.453124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.453433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.453771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.473044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:49.489567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:49.491929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:49.493703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 611/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:49.501197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.553560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.627541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa1e25-2a87-4ef2-b7b3-13730a8d46e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.673002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.673722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.674010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.674289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.675079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:49.675392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.676871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.686149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 598/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:49.692198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.753292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.808504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5cbaa-f9c7-41f4-a54c-6f891020b24a None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.846751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.847597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.847877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.848146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.859205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.860626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:49.878172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:49.880001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:49.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:49.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:49.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:49.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:49.882599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 612/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:49.886912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.002545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:50.005982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0d95-5a08-4d09-a026-53999dc8436d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.042504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.043182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.043465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.043743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.044472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:50.044778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.046255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.059630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 599/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:50.065611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.182275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc21-e25b-4150-a0d2-c22bc77289fb None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.184267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:50.221915 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.222740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.223023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.223296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.233181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.235204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:58:50.250847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:50.252116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:50.253775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 613/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:50.258245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.366495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc996-bf35-44a7-88db-12834b3574f6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.405823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.406555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.406841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.407148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.408015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:50.408325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.409783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.427090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 600/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:58:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:50.432986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.550722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f268-4be5-4921-be79-77c7972e51c7 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.587365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.588015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.588294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.588568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.621365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:50.660504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.662003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.821569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 614/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:58:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:58:50.828049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.848303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:50.934404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97afa-bdfa-40d9-89b3-b72e411863f9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.972176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.976174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.976465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.976732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.990708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.992347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:51.018068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:51.019560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:51.020938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:51.020938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:51.020938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:51.020938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:51.020938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 601/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:51.025348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:51.093166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:51.136972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f15-ccf3-47e4-82ad-05ced4388251 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:51.184556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:51.185233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:51.185518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:51.185947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:51.186700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:51.187002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:51.188433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:51.201672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 615/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:51.208025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:51.296109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:51.331254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dee059-ff61-4e86-9d12-c2cd00ce91ba None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:51.371924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:51.372687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:51.373012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:51.373292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:51.382202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:51.383736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:58:51.399145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:51.400915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:51.402939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 602/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:58:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:51.408564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:51.526376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c290b-a426-4e25-96fb-caa9012ee096 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:51.552931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:51.565964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:51.566642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:51.566922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:51.567195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:51.567997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:51.568306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:51.569813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3714-6832-42e1-9504-2e695a6cbe37 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:51.583705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 616/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:51.589939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:51.699601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19feea2-22c8-4e25-b5eb-9d08f37ae257 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:51.731539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:51.738071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:51.738740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:51.739079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:51.739361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:51.740201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=06e6c97215674774b1bbb18cfde54df9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:51.740532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:51.741993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abe8cd-3b63-4956-b0ef-b7b9d1028451 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:51.748240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 603/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:58:51 2022] GET /identity/v3/role_assignments?user.id=06e6c97215674774b1bbb18cfde54df9&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:53.861533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605768d-bca4-4467-9a3c-bac15377353d None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:53.862088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605768d-bca4-4467-9a3c-bac15377353d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:53.862088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605768d-bca4-4467-9a3c-bac15377353d None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:53.863490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 617/1220] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:53.869187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:53.869780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:53.869780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:53.887888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:53.889649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:53.969299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 604/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:58:53.993135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605768d-bca4-4467-9a3c-bac15377353d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.109363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605768d-bca4-4467-9a3c-bac15377353d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:54.149357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:54.150131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.150464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.150746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.162914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:54.171484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:54.179092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:54.181071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 618/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:54.182315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.289694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b427-6062-4419-bfdd-093ac84fac27 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:54.317427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:54.329001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:54.329728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.330013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.330292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.331059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:54.331375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:54.332780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:54.342073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 605/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:54.348628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.396120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:54.457940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d20f33-3d9f-4dbc-9650-195e2ca1b32d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:54.494384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:54.499132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.499132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.499132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.509259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:54.510713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:54.532061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:54.545753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:54.547101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:54.547101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:54.547101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:54.547101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:54.547101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 619/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:58:54.547448 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.664693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d7c2-2636-4908-aeb9-a264ea56c4be None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:54.702436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:54.703126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.703411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.703688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.704420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:54.704724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:54.706151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:54.719890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 606/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:54.725689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.828656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:54.836615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046c306-a7b6-4294-b385-7cca71907eac None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:54.877322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:54.878173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.878463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.878740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.887456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:54.888931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:58:54.922153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:54.924381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:54.926571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 620/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:54.927895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:54.965503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:55.019861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc054-3800-43a2-a89c-93bb0f504e40 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.054721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.055401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.055684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.055959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.056807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:55.057112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.058582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.078381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 607/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:58:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:55.085486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.209053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a21f-82d3-4e23-9650-c2cfe4d32ff2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.247920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.248755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.249043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.249321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.260533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.262041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:55.280882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:55.282900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:55.284148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:55.284148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:55.284148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:55.284148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:55.284148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 621/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:55.288268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.391007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1faa07-e074-4bbf-9837-1876e0afae57 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.393329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:55.424666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.425335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.425645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.425931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.426646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:55.426950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.428325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.441157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 608/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:55.448253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.458940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:55.560368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cef19-74d8-4c72-9a08-b9b05758112c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.596272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.597081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.597372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.597676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.604764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.606314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:58:55.621926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:55.629256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:55.631043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 622/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:55.631943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.738365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61662069-6038-45c8-9abf-ce8a83ccde10 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.776620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.777290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.777603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.777883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.778705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:55.779014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.780497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6000e-2242-45a5-a565-35e43beb7fd3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.793499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 609/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:55.800728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.873862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:55.910553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462b33-f638-431e-856a-f2e26fcaea57 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.948159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.949060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.949345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.949650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/06e6c97215674774b1bbb18cfde54df9/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.967472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=06e6c97215674774b1bbb18cfde54df9, role_id=9f8b58ad3dd84bf68e9852ea6d6aee4f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.969416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55178eaf-5321-4349-a411-e6339760bcab None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:56.101149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 623/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:58:55 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/06e6c97215674774b1bbb18cfde54df9/roles/9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:58:58.211094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791aeb-f0e0-48cf-ae88-aac86129960a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.211609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791aeb-f0e0-48cf-ae88-aac86129960a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.211609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791aeb-f0e0-48cf-ae88-aac86129960a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.213132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 610/1233] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:58.218957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.219462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.219568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.237332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:58.238560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:58.310757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 624/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:58:58.336018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791aeb-f0e0-48cf-ae88-aac86129960a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:58.362779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:58.442659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791aeb-f0e0-48cf-ae88-aac86129960a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:58.480629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:58.481453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.481778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.482061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.493398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:58.501520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:58.502717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:58.503716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 611/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:58.508961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:58.560754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:58.617025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a87c7-b5a7-470f-ab75-a90ae0c0c3f4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:58.661071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:58.662284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.662808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.663325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.664786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:58.665354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:58.667757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:58.683254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 625/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:58.692096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:58.779848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:58.796657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69e47-cda7-48d4-ae91-d44954c0d96c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:58.833035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:58.833867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.834149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.834425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.846533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:58.848016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:58.866240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:58.867430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:58.868388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:58.868388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:58.868388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:58.868388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:58.868388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 612/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:58.875318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.002967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076aab-95b3-4472-9983-438e0bdbc0bb None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.012663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.041861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.041861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.041861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.041861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.042337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:59.042337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.042337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.054495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 626/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.060713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.188244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45166-4d1f-45fb-876d-f792257aac57 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.222388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.223191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.223468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.223740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.226719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.232036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.234117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:58:59.249649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:59.255849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:58:59.257445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 613/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:59.258858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.364748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bed05-ffc5-4591-ace2-65158efcea94 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.423883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.425088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.425631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.426141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.427778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:59.428342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.431200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.452586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 627/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.458620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.563166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e22ab-16c0-4b60-a951-5997207f543e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.599449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.600118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.600425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.600874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.668890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.675949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.677436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.786964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 614/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:58:59.793174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.823616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.898352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e89d8-e307-4cb6-9a67-81c3c577f429 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.934015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.934733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.935022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.935303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.946694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.952565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:59.968275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:59.969431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:59.975415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:59.975415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:59.975415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:59.975415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:58:59.975415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 628/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:59.975802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.075760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.082152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9a07-8649-4686-9eb7-ee20e20f85a3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.117462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.118183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.118466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.118739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.119463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:00.119763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.121153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.133924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 615/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.142838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.230794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.254285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f011c-7289-46b4-9389-23a841ade040 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.289764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.290559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.290843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.291113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.299529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.300992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:00.315761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:00.316930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:00.318130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 629/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:00.322995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.425353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b683-20a7-44e9-8746-154587606126 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.461047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.461899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.462230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.462565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.463434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:00.463769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.465222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cda14-991a-4995-a67d-3e03fec1faa9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.479495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 616/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.486134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.599006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aebd00-af3c-4809-b455-1073d7c7557c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.636503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.637169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.637456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.637773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.638611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] RBAC: Adding query filter params (role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=06e6c97215674774b1bbb18cfde54df9) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:00.638942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.640406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84408-e6eb-4e2c-a421-3a6bb5485fbb None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.646888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 630/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/role_assignments?user.id=06e6c97215674774b1bbb18cfde54df9&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=9f8b58ad3dd84bf68e9852ea6d6aee4f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:02.792465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a935-1320-4c67-a189-4a7ee1c365da None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:02.793073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a935-1320-4c67-a189-4a7ee1c365da None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:02.793073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a935-1320-4c67-a189-4a7ee1c365da None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:02.794423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 617/1247] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:02.800636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:02.801417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:02.801417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:02.809137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:02.822388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:02.823603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:02.895965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 631/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:59:02.923201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a935-1320-4c67-a189-4a7ee1c365da None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:02.943333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.039263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a935-1320-4c67-a189-4a7ee1c365da None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.076091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.077410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.077796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.078115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.089474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:03.098249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:03.099415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:03.100323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 618/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:03.106430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.217984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02693e4e-8bb0-485a-914e-61b3a3140383 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.248157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.253822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.254493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.254772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.255045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.255787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:03.256091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.257552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.267275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 632/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:03.273131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.360350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.385474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa484-8b57-400b-b987-8b96b87dbbf2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.423773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.424590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.424868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.425148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.437731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.439207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:03.457932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:03.459967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:03.461500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:03.461500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:03.461500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:03.461500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:03.461500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 619/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:03.465450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.578946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b428cc-5a60-4fb8-96aa-1965e9665900 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.618284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.618874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.619166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.619443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.620174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:03.620485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.621900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.635739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 633/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:03.642476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.767442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc84ea-0fc7-4b33-83ba-8ce3160e66ca None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.796163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.805173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.806015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.806320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.806600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.816500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.818015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:03.834381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:03.840841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:03.842033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 620/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:03.843106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.907768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.955419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750867-075d-4b5c-bb94-4f7ee89460bf None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.994752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.995447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.995739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.996153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.997027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:03.997344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.999218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.022670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 634/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.029101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.142433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd86b-00d7-4046-b5c9-06c05735b731 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.192785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.193350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.193659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.193938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.260241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.275745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.277341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.394199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 621/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:04.400845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.517683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25092977-97d7-407a-8f49-e9b09b9918d0 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.536173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.560122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.561182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.561531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.561857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.573399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.574936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:04.595979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:04.602274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:04.604000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:04.604000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:04.604000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:04.604000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:04.604000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 635/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:04.604881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.750285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.772465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7b62-58b3-488a-afc0-1979fc09791f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.834768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.835944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.836446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.836939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.838388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:04.839012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.841646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.864730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 622/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:04.870994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.003563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041898-807c-464c-b85a-0bedff1b0c1c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.043537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.044345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.044627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.044924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.053975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:05.055445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:05.071314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:05.072496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:05.073408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 636/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:05.079144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.203561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588de47b-194f-41b7-b576-50cafa10e841 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.246005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.246695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.246974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.247292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.248072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:05.249137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:05.251089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd3743-ae98-4967-867f-a9374003c0e9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:05.266027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 623/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:05.272519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.304738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.408255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0165a-eaac-4140-b4ad-9f13beac6f67 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.451112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.452173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.452588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.452876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.453781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=06e6c97215674774b1bbb18cfde54df9) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:05.454092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:05.455605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977c1d-8188-48fc-ae18-fa886f43f598 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:05.464676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 637/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/role_assignments?user.id=06e6c97215674774b1bbb18cfde54df9&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:07.615788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94dff7-4392-4874-98e6-0aa8414bc332 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.616337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94dff7-4392-4874-98e6-0aa8414bc332 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.616337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94dff7-4392-4874-98e6-0aa8414bc332 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.617881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 624/1261] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:07.626383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.626927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.626927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.649609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:07.650957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:07.730384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 638/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:59:07.756115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94dff7-4392-4874-98e6-0aa8414bc332 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:07.770261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:07.878974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94dff7-4392-4874-98e6-0aa8414bc332 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.921487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.922255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.922533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.922923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.936954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:07.945361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:07.947124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:07.948025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 625/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:07.954663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:07.975736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.077822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb2766-6657-405e-a7c5-bdcfcedc4075 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.116215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.116904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.117190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.117468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.118402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:08.118711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.120121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.130521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 639/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:08.136724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.239303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.304173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5005b6-52cb-498c-9d18-90c5ffe99537 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.369784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.371183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.371691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.372191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.391317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.392735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:08.412701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:08.414488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:08.415775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:08.415775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:08.415775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:08.415775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:08.415775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 626/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:08.420771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.517278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.539863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff3a-fa02-4832-a0ab-354ec754035c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.578827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.579543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.579872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.580149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.580988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:08.581295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.582728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.596798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 640/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:08.606521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.742898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0897e-d059-4859-9810-94c8b52ed4c6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.770094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.792250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.793173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.793457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.793771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.804841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.806366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:08.823174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:08.826173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:08.827322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 627/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:08.830648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.953325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec391-8f52-4ad4-9b49-d2d0d237b00f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.997225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.998010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.999087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.999270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.000277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:09.000592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.002296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.013399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.024134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 641/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:09.031211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.166612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1dff-e186-48be-829b-cfe8fb9f2e8e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.206921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.207868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.208147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.208424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.221802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.223314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:09.243979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:09.245919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:09.247795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:09.247795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:09.247795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:09.247795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:09.247795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 628/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:09.251889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.364478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ef328-b8bb-4010-9090-e8babedc1a5f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.403813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.407715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.407715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.407715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.407715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:09.407715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.408898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.424014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 642/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:09.430306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.469148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.551979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf527ec-73df-41e9-a445-663aa8c4c35b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.591396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.592485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.592855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.593174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.601140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.602756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:09.619941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:09.621851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:09.623157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 629/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:09.629312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.710377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.785598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e69f-6026-489b-862b-e021e35c57d2 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.837487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.837487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.837487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.837487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.838649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:09.838649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.839301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057e90b-b925-4d2e-a20f-6a448b337c65 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.854754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 643/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:09.862787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.971982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.981787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64535795-ec03-4dc8-9168-bc1889cf16cf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:10.028461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:10.029390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.030250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.030547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] PATH_INFO: `/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/06e6c97215674774b1bbb18cfde54df9/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.032746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user_id=06e6c97215674774b1bbb18cfde54df9, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:10.034285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0665-3511-4270-bfaa-bf8d776875b0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:10.233519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 630/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:09 2022] PUT /identity/v3/projects/85c6d5fe72544ba5a9a5b34b39ddf7e1/users/06e6c97215674774b1bbb18cfde54df9/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 13:59:12.408903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f05dc-9654-4223-9426-9e69e510733e None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.409532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f05dc-9654-4223-9426-9e69e510733e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.409532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f05dc-9654-4223-9426-9e69e510733e None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.410962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 644/1274] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:12.417026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.417621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.417621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.435311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:12.437725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:12.521560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 631/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:59:12.547911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f05dc-9654-4223-9426-9e69e510733e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.666527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f05dc-9654-4223-9426-9e69e510733e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.685543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.703578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.704458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.704860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.705257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.716619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:12.724819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:12.726067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:12.727429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 645/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:12.732315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.829779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.850444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc482ee-a742-4b27-8cc3-9a905c746e18 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.889179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.889922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.890205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.890480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.891232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:12.891535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.892918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.905902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 632/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:12.912239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.028704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a57ff-1c7c-49c5-adcd-a708672fc20f None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.066071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.066888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.067176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.067453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.080150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.081820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:13.102322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:13.103510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:13.104466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:13.104466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:13.104466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:13.104466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:13.104466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 646/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:13.110827 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.245560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb12e-0ccc-437e-ad6a-4abdfcb0338f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.285890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.286452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.286736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.287017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.287797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:13.288227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.289772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.304386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 633/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.310463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.354763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.436853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0717b-d2fa-4b46-9d95-ef30e07558ca None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.478651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.479609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.479891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.480165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.490524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.492168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:13.509116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:13.511271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:13.513118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 647/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:13.517639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.521802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.636790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7757f-d404-4da0-94f1-c7a408d4c33d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.677603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.678302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.678587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.678863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.679723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:13.680032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.681497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.703328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 634/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:13.709616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.812871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.823297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012469e2-c618-4786-a319-ee8570b45e8d None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.861293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.861991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.862271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.862544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.948529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.950033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.053802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.065363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 648/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:14.071325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.142113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.184831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bb808-f005-47b5-9e3d-6f81cdda2be8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.220497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.221296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.221603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.221878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.233155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.234693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:14.254661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:14.255968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:14.261538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:14.261538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:14.261538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:14.261538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:14.261538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 635/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:14.261851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.376096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb510acf-1e44-4c34-ae84-18cd38300b7c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.413472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.414184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.414475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.414751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.415496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.415802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.417208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.433881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 649/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.439903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.550494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8e892-898c-4392-8995-9a7eb7d1aaac None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.567303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.588617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.589437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.589811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.590199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.598254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.599758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:14.616372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:14.624557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 11 13:59:14.626289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 636/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:14.627256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.679752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.736382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641356-2e8c-4706-9238-34921db90652 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.773371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.774070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.774352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.774628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.775409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.775716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.777160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64499f-0360-40ac-b099-c0056d40c826 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.790167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 650/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:14.797414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.905729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d557a-5b43-4b67-88aa-8e2090cf38f1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.941416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.942142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.942426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.942704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.943525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] RBAC: Adding query filter params (role.id=8a17c9667c6f4151aa26d4dbece282ef, scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1, user.id=06e6c97215674774b1bbb18cfde54df9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.943836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.945371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9bbf-ae20-42db-b270-e2cb9204d4a5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.952317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 637/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/role_assignments?user.id=06e6c97215674774b1bbb18cfde54df9&scope.project.id=85c6d5fe72544ba5a9a5b34b39ddf7e1&role.id=8a17c9667c6f4151aa26d4dbece282ef => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:17.085099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9132e6-33cc-4b68-9ea4-71836c1ca61a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.085698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9132e6-33cc-4b68-9ea4-71836c1ca61a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.085698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9132e6-33cc-4b68-9ea4-71836c1ca61a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.087183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 651/1288] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:17.096932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33204-38d6-4f96-a744-39062413baef None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.097538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33204-38d6-4f96-a744-39062413baef None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.097958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33204-38d6-4f96-a744-39062413baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.120132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-46a33204-38d6-4f96-a744-39062413baef None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:17.121429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-46a33204-38d6-4f96-a744-39062413baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:17.155291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.194811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 638/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:59:17.218717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9132e6-33cc-4b68-9ea4-71836c1ca61a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.326989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9132e6-33cc-4b68-9ea4-71836c1ca61a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.338942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.364413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.365221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.365508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.365818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.366479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.368060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:17.381537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:17.383585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:17.385253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 652/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:17.389689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33204-38d6-4f96-a744-39062413baef None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.514515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33204-38d6-4f96-a744-39062413baef None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.552502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.553171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.553449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.553752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.554462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:17.554766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.556300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456e998-87e5-4d5d-87e1-e03c2067a166 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.562253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 639/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:17.568347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.676919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666aac-9c3d-4dfc-80fc-dc99ba548622 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.721337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.722338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.722639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.723145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] PATH_INFO: `/v3/services` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.724623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:17.725191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.727967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94befc7b-48a6-47a2-b7df-5aa7c87ee14f None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.736455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 653/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:19.849292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb56-af99-4b2a-97d4-97fbe7fe6f31 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.849893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb56-af99-4b2a-97d4-97fbe7fe6f31 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.850458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fb56-af99-4b2a-97d4-97fbe7fe6f31 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.853123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 640/1293] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:19.860599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411cfd1-62df-4f48-8ba4-9b30466a9af6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.861683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411cfd1-62df-4f48-8ba4-9b30466a9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.861683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411cfd1-62df-4f48-8ba4-9b30466a9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.880072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6411cfd1-62df-4f48-8ba4-9b30466a9af6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:19.881258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6411cfd1-62df-4f48-8ba4-9b30466a9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:19.915477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.964116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 654/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 13:59:19.991693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fb56-af99-4b2a-97d4-97fbe7fe6f31 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.028429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.109783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fb56-af99-4b2a-97d4-97fbe7fe6f31 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.146876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.147555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.147839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.148114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.148852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:20.150361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a66d5e-be0c-4146-afa8-1c620c4ee8fc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:20.384216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 641/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Mon Jul 11 13:59:19 2022] POST /identity/v3/services => generated 246 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:59:22.562858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe5bb-ab4c-488f-ba4b-3c16ee44cf54 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.566486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe5bb-ab4c-488f-ba4b-3c16ee44cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.566486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe5bb-ab4c-488f-ba4b-3c16ee44cf54 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.566486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 655/1296] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:22.571564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.572061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.572173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.590427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:22.591678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:22.677145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 642/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:59:22.700947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fe5bb-ab4c-488f-ba4b-3c16ee44cf54 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:22.815636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fe5bb-ab4c-488f-ba4b-3c16ee44cf54 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:22.852959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:22.853878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.854156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.854431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.855105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:22.856507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:22.869492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:22.870839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:22.871800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 656/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:59:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:22.877090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:22.897245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:22.991099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a6c3e-db59-434a-9cec-d35171318229 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.027998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.028730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.029012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.029310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.030611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:23.030913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.032392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.038741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 643/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Mon Jul 11 13:59:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:23.053568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.094993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.170287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4c47-0a8c-48b4-ac15-95016cfac277 None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.206594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.207298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.207631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.207955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.208863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] RBAC: Adding query filter params (interface=public, service_id=2fc8669fa44e43088ced8b95eb75d926, region_id=RegionOne) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:23.209234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.210711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2909a-68b0-428f-9a55-20532fd4713d None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.216698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 657/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/endpoints?service_id=2fc8669fa44e43088ced8b95eb75d926&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:23.223675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.323279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.344262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbf9ab-40f3-4d83-86f6-bcde5d018b89 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.380056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.380698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.380896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.381178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.381885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.383248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f7b30-1915-4a8d-bf98-011b31495d05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.391248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 644/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 13:59:25.506765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ab46-1d60-4df2-8bb7-8d7f83ec72a8 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.507340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ab46-1d60-4df2-8bb7-8d7f83ec72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.507340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ab46-1d60-4df2-8bb7-8d7f83ec72a8 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.508674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 658/1302] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:25.513765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.514192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.514652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.531060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:25.532235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:25.600514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 645/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 13:59:25.625612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ab46-1d60-4df2-8bb7-8d7f83ec72a8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.737106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.744769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ab46-1d60-4df2-8bb7-8d7f83ec72a8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.791518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.792414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.792704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.792988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.793721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.795925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:25.811521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:25.812921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: ERROR keystone.server.flask.application Jul 11 13:59:25.813908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 659/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:25.819774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.916110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.944640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64512c2-b02f-4887-ac84-9407c4c14670 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.989027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.989743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.990029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.990300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.991022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:25.991322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.992753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ccd03-95fd-420a-8623-aa2a6ac938f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.000011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 646/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:26.006022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.134189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631776-2b92-4785-97f5-b8be7493471c None admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.175737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.176421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.180287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.180287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.180287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.180287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6317cd-d148-4260-9ed4-f01a504cc8dc None admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.355138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 660/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Mon Jul 11 13:59:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:35.998881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=30 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.348578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:34.828110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69391-ac2c-4929-a153-281755a0b64e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:34.829389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69391-ac2c-4929-a153-281755a0b64e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:34.830004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69391-ac2c-4929-a153-281755a0b64e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:34.831639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 647/1307] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:34.837272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7677-f325-4550-afa6-d7cec9101b11 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:34.837810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7677-f325-4550-afa6-d7cec9101b11 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:34.838150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7677-f325-4550-afa6-d7cec9101b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:34.992692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-095f7677-f325-4550-afa6-d7cec9101b11 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:34.993867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-095f7677-f325-4550-afa6-d7cec9101b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:35.282712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 661/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:35.362197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:35.362487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:35.362765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:35.364409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 648/1309] 10.222.0.60 () {54 vars in 964 bytes} [Mon Jul 11 14:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:35.371286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dead7-e02b-4d56-8f0b-c05dc00d851e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:35.371589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dead7-e02b-4d56-8f0b-c05dc00d851e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:35.371862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dead7-e02b-4d56-8f0b-c05dc00d851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:35.470508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-316dead7-e02b-4d56-8f0b-c05dc00d851e None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:35.472029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-316dead7-e02b-4d56-8f0b-c05dc00d851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:35.496028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:35.557553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 662/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Mon Jul 11 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:06:35.566995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:35.569336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:35.696412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980faf2-f230-4c4e-b281-ba0c60c75952 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:35.780924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:35.781510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:35.782415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:35.782717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:35.784621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:35.848224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:35.916664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:35.918316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dc0b3-6b6b-49ed-8811-43de6ed49780 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:35.941601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 649/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:38.309466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:38.310079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:38.310079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:38.311453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 663/1312] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:38.317474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc248c6-f536-448c-a051-2f7dfcd4fd30 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:38.317969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc248c6-f536-448c-a051-2f7dfcd4fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:38.318064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc248c6-f536-448c-a051-2f7dfcd4fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:38.392549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3fc248c6-f536-448c-a051-2f7dfcd4fd30 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:38.394214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3fc248c6-f536-448c-a051-2f7dfcd4fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:38.506377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 650/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:38.546992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:38.548675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:38.653053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96964d-cf59-439a-b51b-9781efbec100 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:38.728871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:38.731511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:38.732170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:38.732455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:38.732737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:38.734566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:38.853660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:38.855109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e785e9-1052-46b4-b221-484888b7e0e2 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:38.873694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 664/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:41.528643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:41.529230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:41.529230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:41.530608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 651/1315] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:41.536447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ccaa-c0b7-472c-80fb-89ec29cdca9a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:41.536881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ccaa-c0b7-472c-80fb-89ec29cdca9a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:41.536994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ccaa-c0b7-472c-80fb-89ec29cdca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:41.603530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cfb3ccaa-c0b7-472c-80fb-89ec29cdca9a None None] MFA Rules not processed for user `7422ae993f7544029fe6660532dc772b`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:41.604765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cfb3ccaa-c0b7-472c-80fb-89ec29cdca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:41.655850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:41.700524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 665/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:41.741303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:41.742889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:41.752859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:41.850374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca339a-6782-4245-9529-c40196bcdd18 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:41.925165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:41.925843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:41.926125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:41.926396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:41.928078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:41.990640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:42.037836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:42.039275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe465a-8c6c-472f-bd6e-c8b45fc8d225 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:42.057374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 652/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:44.893237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8ab3-a3ea-45ae-bdec-fa417476b77f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:44.893790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8ab3-a3ea-45ae-bdec-fa417476b77f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:44.893912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8ab3-a3ea-45ae-bdec-fa417476b77f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:44.895227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 666/1318] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:44.900605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade0e4-f7c1-4195-93c9-d88e0c1c3e45 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:44.901025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade0e4-f7c1-4195-93c9-d88e0c1c3e45 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:44.901169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade0e4-f7c1-4195-93c9-d88e0c1c3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:44.965706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-71ade0e4-f7c1-4195-93c9-d88e0c1c3e45 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:44.966923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71ade0e4-f7c1-4195-93c9-d88e0c1c3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.064405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 653/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:45.117643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.117930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.118217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.119585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 667/1320] 10.222.0.60 () {54 vars in 964 bytes} [Mon Jul 11 14:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:45.126381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095c6f-e4e4-43fc-b0cc-2a5169d7eaba None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.126667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095c6f-e4e4-43fc-b0cc-2a5169d7eaba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.126945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095c6f-e4e4-43fc-b0cc-2a5169d7eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.148972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:45.207776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b5095c6f-e4e4-43fc-b0cc-2a5169d7eaba None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:45.209007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b5095c6f-e4e4-43fc-b0cc-2a5169d7eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.291098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 654/1321] 10.222.0.60 () {58 vars in 1061 bytes} [Mon Jul 11 14:06:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:45.301101 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:45.302720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.412067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1d85d-7a8b-415d-b100-aaf8decd1132 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:45.496343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:45.496997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.497284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.497563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.499269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.508425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:45.618608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:45.620065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244852b0-8cee-4150-aa7f-c0ea7cad60f6 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:45.638712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 668/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:49.216641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:49.217154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:49.217154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:49.218720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 655/1323] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:49.224081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bc3a-3587-40aa-9e79-39104859e28d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:49.224568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bc3a-3587-40aa-9e79-39104859e28d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:49.224792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bc3a-3587-40aa-9e79-39104859e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:49.298699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1814bc3a-3587-40aa-9e79-39104859e28d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:49.299570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1814bc3a-3587-40aa-9e79-39104859e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:49.364912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:49.405110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 669/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:49.442245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:49.443864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:49.560497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb54f1-2552-4a3e-864e-7d9d5c2e49ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:49.574082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:49.641825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:49.642484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:49.642766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:49.643041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:49.644995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:49.763218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:49.765357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af50a-b25c-4bd8-943c-326af3968af9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:49.785652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 656/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:51.946526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:51.947154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:51.947154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:51.948452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 670/1326] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:51.954287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd450f-cfaa-44b4-8c62-471a498d55b5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:51.954772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd450f-cfaa-44b4-8c62-471a498d55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:51.954880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd450f-cfaa-44b4-8c62-471a498d55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:52.003282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:52.022381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d5dd450f-cfaa-44b4-8c62-471a498d55b5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:52.023615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d5dd450f-cfaa-44b4-8c62-471a498d55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:52.128963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 657/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:52.166219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:52.167806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:52.278022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3419f2-d12a-440a-8407-3e4a0de6ac68 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:52.357096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:52.357792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:52.358085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:52.358366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:52.360166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:52.379191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:52.480505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:52.482090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52115e84-3f4b-4301-93b9-4984db524349 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:52.503016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 671/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:54.696949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:54.697480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:54.697480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:54.699097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 658/1329] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:54.705132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838525-f125-43fa-aab6-b37eb32e45ed None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:54.705699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838525-f125-43fa-aab6-b37eb32e45ed None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:54.705814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838525-f125-43fa-aab6-b37eb32e45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:54.783426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-76838525-f125-43fa-aab6-b37eb32e45ed None None] MFA Rules not processed for user `7422ae993f7544029fe6660532dc772b`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:54.784655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-76838525-f125-43fa-aab6-b37eb32e45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:54.858164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:54.891472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 672/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:54.931253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:54.932966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:55.061110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b82b-a0df-44dc-b8e0-35628192b6ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:55.084293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:55.158443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:55.159103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:55.159379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:55.159648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:55.161344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:55.291069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:55.292526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4250-56dc-450a-8a39-afaf1fb398ce service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:55.312265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 659/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:57.944688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:57.945207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:57.945207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:57.946565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 673/1332] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:57.952384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1cda-ffbe-4aff-9fb2-af1900eae793 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:57.953494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1cda-ffbe-4aff-9fb2-af1900eae793 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:57.953494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1cda-ffbe-4aff-9fb2-af1900eae793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:58.024123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:58.027280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d7ef1cda-ffbe-4aff-9fb2-af1900eae793 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:58.028515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d7ef1cda-ffbe-4aff-9fb2-af1900eae793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:58.135604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 660/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:58.172298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:58.173896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:58.286128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a2246-2249-4a52-b2ec-41f1fc08ac5f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:58.359047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:58.359712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:58.360001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:58.360280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:58.362063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:58.392126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:58.480056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:58.481514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f6c33-8d68-4316-b9dc-3340e83f485c service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:58.501689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 674/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:00.648102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:00.648680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:00.648680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:00.650107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 661/1335] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:00.656776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde79-a4e9-433a-b30c-7484542a2f44 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:00.657393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde79-a4e9-433a-b30c-7484542a2f44 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:00.657827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde79-a4e9-433a-b30c-7484542a2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:00.746818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-417dde79-a4e9-433a-b30c-7484542a2f44 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:00.748071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-417dde79-a4e9-433a-b30c-7484542a2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:00.835735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:00.861887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 675/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:00.903840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:00.905308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:01.022750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9a65-5279-49f3-8145-420a6a05b520 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:01.056500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:01.138168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:01.139292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:01.139806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:01.140355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:01.143824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:01.320020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:01.321487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9af45-45db-4d05-9fd0-b31e62d254ec service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:01.342444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 662/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:04.197411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:04.198114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:04.198114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:04.199273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 676/1338] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:04.205137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe6f6-6e70-4c1a-b08e-fd97be68d68b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:04.205735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe6f6-6e70-4c1a-b08e-fd97be68d68b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:04.205735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafe6f6-6e70-4c1a-b08e-fd97be68d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:04.286383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7bafe6f6-6e70-4c1a-b08e-fd97be68d68b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:04.287702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7bafe6f6-6e70-4c1a-b08e-fd97be68d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:04.298704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:04.430589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 663/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:04.469440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:04.471156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:04.592421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e398-a322-4685-a5ee-66061a909148 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:04.681723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:04.682409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:04.682691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:04.682969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:04.684812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:04.729316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:04.826107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:04.828113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd85da-1dd1-4c19-9e9b-cdbd2b72406e service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:04.848684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 677/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:09.352861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:09.353439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:09.353439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:09.354912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 664/1341] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:09.360438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b54e9-f70e-4dd7-828a-a56c7744e2dc None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:09.361018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b54e9-f70e-4dd7-828a-a56c7744e2dc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:09.361119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b54e9-f70e-4dd7-828a-a56c7744e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:09.449099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8e5b54e9-f70e-4dd7-828a-a56c7744e2dc None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:09.450522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8e5b54e9-f70e-4dd7-828a-a56c7744e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:09.555013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:09.581765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 678/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:09.619303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:09.621116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:09.733200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512b6aa-7384-48fd-8ec8-e82549c37499 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:09.774382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:09.816828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:09.817673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:09.818019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:09.818364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:09.820170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:09.941913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:09.943482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb3cc-81d9-4143-b642-5e870a88d5ed service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:09.966111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 665/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:13.063595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:13.064117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:13.064224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:13.065566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 679/1344] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:13.071267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960b2e7-e31a-4e91-b3ea-a9f0e31f249d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:13.071774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960b2e7-e31a-4e91-b3ea-a9f0e31f249d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:13.071894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960b2e7-e31a-4e91-b3ea-a9f0e31f249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:13.137958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4960b2e7-e31a-4e91-b3ea-a9f0e31f249d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:13.139193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4960b2e7-e31a-4e91-b3ea-a9f0e31f249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:13.158767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:13.240352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 666/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:13.277796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:13.279384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:13.388775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33e3bd-e03c-48df-b118-ba426e454014 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:13.465273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:13.465953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:13.466238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:13.466514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:13.468247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:13.521711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:13.593471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:13.595012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18761497-cc75-4a83-a1b2-db4760c511ea service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:13.617152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 680/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:18.346259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:18.346802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:18.346903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:18.348233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 667/1347] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:18.354233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907d88-4ea9-439e-ad95-39b027cde133 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:18.354786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907d88-4ea9-439e-ad95-39b027cde133 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:18.354786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907d88-4ea9-439e-ad95-39b027cde133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:18.426979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2b907d88-4ea9-439e-ad95-39b027cde133 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:18.428217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2b907d88-4ea9-439e-ad95-39b027cde133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:18.539819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:18.542397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 681/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:18.583471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:18.585017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:18.703658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357a5d-4993-41f8-b78b-ffcdcfa476bc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:18.756980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:18.784775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:18.785424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:18.785775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:18.786034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:18.787742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:18.907009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:18.908462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fd699-c29a-4343-b123-cc9a43eb6317 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:18.927303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 668/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:24.320910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a374-0a34-4b4f-b48b-51258ff62d31 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:24.323140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a374-0a34-4b4f-b48b-51258ff62d31 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:24.323140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a374-0a34-4b4f-b48b-51258ff62d31 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:24.326066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 682/1350] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:24.331958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a76c-10b3-4906-9289-17be3ad15186 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:24.332450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a76c-10b3-4906-9289-17be3ad15186 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:24.332538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a76c-10b3-4906-9289-17be3ad15186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:24.433703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d66a76c-10b3-4906-9289-17be3ad15186 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:24.434855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d66a76c-10b3-4906-9289-17be3ad15186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:24.477556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:24.591744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 669/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:29.067032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c17d-0d35-4373-8d69-35e64e40c6ee None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:29.067527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c17d-0d35-4373-8d69-35e64e40c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:29.067752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c17d-0d35-4373-8d69-35e64e40c6ee None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:29.069529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 683/1352] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:29.074699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9b25-440c-4df5-9520-80997701191d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:29.075235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9b25-440c-4df5-9520-80997701191d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:29.075486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9b25-440c-4df5-9520-80997701191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:29.160211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-971a9b25-440c-4df5-9520-80997701191d None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:29.161417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-971a9b25-440c-4df5-9520-80997701191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:29.246126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:29.284594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 670/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:30.704723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738c9a-f663-4ae5-a246-b57f795190ec None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:30.705338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738c9a-f663-4ae5-a246-b57f795190ec None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:30.705476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738c9a-f663-4ae5-a246-b57f795190ec None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:30.707117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 684/1354] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:30.712601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af0c3-e1ea-4a1b-9693-9712ed8e8cc7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:30.713210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af0c3-e1ea-4a1b-9693-9712ed8e8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:30.713210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af0c3-e1ea-4a1b-9693-9712ed8e8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:30.801962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c51af0c3-e1ea-4a1b-9693-9712ed8e8cc7 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:30.803197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c51af0c3-e1ea-4a1b-9693-9712ed8e8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:30.919097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 671/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:07:34.625147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d332-a4ad-404f-abbd-7fef9d8e726b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:34.625706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d332-a4ad-404f-abbd-7fef9d8e726b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:34.626769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1d332-a4ad-404f-abbd-7fef9d8e726b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:34.627687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 685/1356] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:34.633384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6d92c-46d7-45d0-abdf-81cd9a66fff2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:34.633935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6d92c-46d7-45d0-abdf-81cd9a66fff2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:34.635210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6d92c-46d7-45d0-abdf-81cd9a66fff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:34.689425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:34.735651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f2b6d92c-46d7-45d0-abdf-81cd9a66fff2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:34.737305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f2b6d92c-46d7-45d0-abdf-81cd9a66fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:34.875885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 672/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:34.935595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:34.937142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:34.939413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:34.944344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 686/1358] 10.222.0.60 () {54 vars in 961 bytes} [Mon Jul 11 14:07:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:34.951124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa148e-8e1b-4458-8a2b-605dc9bdeafb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:34.951946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa148e-8e1b-4458-8a2b-605dc9bdeafb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:34.952499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa148e-8e1b-4458-8a2b-605dc9bdeafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:35.052397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-96fa148e-8e1b-4458-8a2b-605dc9bdeafb None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:35.053662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96fa148e-8e1b-4458-8a2b-605dc9bdeafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:35.121938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:35.215027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 673/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Jul 11 14:07:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:35.223823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:35.227942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:35.428461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7aa9-f06b-448f-b6a7-101869d8429a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:35.542197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:35.594644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:35.595450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:35.595735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:35.596013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:35.598219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:35.713074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:35.714864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01ce39-d5ac-4ca4-a917-1cea21208c09 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:35.737169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 687/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:38.029611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:38.030141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:38.030141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:38.031620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 674/1361] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:38.036757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe3e-88ab-4c35-ab46-ac35d4abaa2f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:38.037177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe3e-88ab-4c35-ab46-ac35d4abaa2f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:38.037347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe3e-88ab-4c35-ab46-ac35d4abaa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:38.111024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-55b8fe3e-88ab-4c35-ab46-ac35d4abaa2f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:38.112237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-55b8fe3e-88ab-4c35-ab46-ac35d4abaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:38.160518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:38.233326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 688/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:38.280057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:38.281558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:38.486851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eee075-a4bf-4da0-84d8-bbe2c93afb24 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:38.497275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:38.610362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:38.611117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:38.611469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:38.611823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:38.613569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:38.708624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:38.710394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55118950-573c-4af7-a6ad-98f88e66f934 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:38.729530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 675/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:07:41.253219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c3d4-4aef-4d31-88c6-df0c414e083b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:41.253773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c3d4-4aef-4d31-88c6-df0c414e083b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:41.253855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52c3d4-4aef-4d31-88c6-df0c414e083b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:41.255421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 689/1364] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:41.261344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09500-7dcc-4275-8c95-8cdfba8cc568 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:41.261901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09500-7dcc-4275-8c95-8cdfba8cc568 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:41.261986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09500-7dcc-4275-8c95-8cdfba8cc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:41.280073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:41.342896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d0e09500-7dcc-4275-8c95-8cdfba8cc568 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:41.344154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0e09500-7dcc-4275-8c95-8cdfba8cc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:41.464132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 676/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:41.508778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:41.509080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:41.509542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:41.511363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 690/1366] 10.222.0.60 () {54 vars in 961 bytes} [Mon Jul 11 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:41.518205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b050-0bf1-413c-8bed-f05ac04df120 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:41.518507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b050-0bf1-413c-8bed-f05ac04df120 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:41.518772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b050-0bf1-413c-8bed-f05ac04df120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:41.602441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-33f2b050-0bf1-413c-8bed-f05ac04df120 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:41.603713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33f2b050-0bf1-413c-8bed-f05ac04df120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:41.644758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:41.735368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 677/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Jul 11 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:41.743218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:41.745147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:41.903250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78e8f-2881-4f84-b771-1d19d2cd0e71 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:41.924798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:42.026556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:42.027126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:42.027419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:42.027691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:42.029848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:42.139448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:42.141630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafab3-6b5e-4998-9fd2-b5538dfee881 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:42.162363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 691/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:07:43.052937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8815-11d6-4afc-99ba-41385ffc84ec None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:43.053494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8815-11d6-4afc-99ba-41385ffc84ec None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:43.053494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8815-11d6-4afc-99ba-41385ffc84ec None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:43.055070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 678/1369] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:43.060550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886f0a-230e-4af9-bd8f-6329215af3e5 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:43.061009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886f0a-230e-4af9-bd8f-6329215af3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:43.061113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886f0a-230e-4af9-bd8f-6329215af3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:43.095135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:43.133602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a3886f0a-230e-4af9-bd8f-6329215af3e5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:43.134817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a3886f0a-230e-4af9-bd8f-6329215af3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:43.241441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 692/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:43.586384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:43.586794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:43.587231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:43.588956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 679/1371] 10.222.0.60 () {54 vars in 963 bytes} [Mon Jul 11 14:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:43.595240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984204-fce2-4bca-83f3-eae10120e049 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:43.595673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984204-fce2-4bca-83f3-eae10120e049 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:43.596059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984204-fce2-4bca-83f3-eae10120e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:43.688853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9e984204-fce2-4bca-83f3-eae10120e049 None None] MFA Rules not processed for user `88ad61a2fb834e31b4a6f6df2f023e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:43.690452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9e984204-fce2-4bca-83f3-eae10120e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:43.749351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:43.784593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 693/1372] 10.222.0.60 () {58 vars in 1060 bytes} [Mon Jul 11 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:43.792925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:43.795070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:43.914188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1133ec-bb48-41f7-80ab-d7970840853e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:43.960926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:44.010062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:44.010718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:44.011106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:44.011391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:44.013572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:44.145422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:44.147015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b106f-dd91-4309-b5c1-128f3835ca4d service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:44.168316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 680/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:44.575891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:44.576473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:44.576641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:44.582094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 694/1374] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:44.583244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751dd3-5a6b-4a49-8eb0-96970cd3780c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:44.583534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751dd3-5a6b-4a49-8eb0-96970cd3780c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:44.583815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751dd3-5a6b-4a49-8eb0-96970cd3780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:44.667776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-70751dd3-5a6b-4a49-8eb0-96970cd3780c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:44.669730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-70751dd3-5a6b-4a49-8eb0-96970cd3780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:44.692564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:44.770239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 681/1375] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:07:44.815955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:44.817488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:44.994647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5e07-b6a4-4a12-a27d-b81c3ebae0ee None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:45.060077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:45.127989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:45.128653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:45.128941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:45.129223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:45.130956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:45.230629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:45.233049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5ecc-ec35-4310-acff-2c5f20227703 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:45.253710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 695/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:47.522933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:47.523461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:47.523461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:47.524745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 682/1377] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:47.531121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e01b9-f4ee-4592-bdd1-fa48b41fef47 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:47.531554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e01b9-f4ee-4592-bdd1-fa48b41fef47 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:47.531684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e01b9-f4ee-4592-bdd1-fa48b41fef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:47.597415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5a3e01b9-f4ee-4592-bdd1-fa48b41fef47 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:47.598918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5a3e01b9-f4ee-4592-bdd1-fa48b41fef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:47.605515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:47.708246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 696/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:47.769662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:47.771298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:47.994679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890511e-9caa-4f2a-9f38-ccb3b55df63d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:47.999887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:48.143770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:48.144758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:48.145147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:48.145524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:48.147428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:48.279512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:48.282810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc3840-e9e1-400f-8571-f6ed87194613 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:48.316129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 683/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:50.548969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:50.549521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:50.549629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:50.551081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 697/1380] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:50.556311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6e37-13df-4420-8e5a-c04370ba7e35 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:50.556715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6e37-13df-4420-8e5a-c04370ba7e35 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:50.556906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6e37-13df-4420-8e5a-c04370ba7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:50.567790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:50.629060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0eee6e37-13df-4420-8e5a-c04370ba7e35 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:50.630522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0eee6e37-13df-4420-8e5a-c04370ba7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:50.755824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 684/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:50.806023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:50.807620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:50.988100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:51.001140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919be50-28f7-4d51-b88c-bde2c65730d3 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:51.132081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:51.132731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:51.133020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:51.133297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:51.135613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:51.239084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:51.240624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa253b0-49a0-4037-ac62-fab7fa2fb535 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:51.253168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:51.263776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 698/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:53.579823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:53.580434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:53.580548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:53.582468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 685/1383] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:53.587835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a2c9-5a8e-4abb-a6cf-c63d1023c148 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:53.588343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a2c9-5a8e-4abb-a6cf-c63d1023c148 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:53.588532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a2c9-5a8e-4abb-a6cf-c63d1023c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:53.672834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-26d5a2c9-5a8e-4abb-a6cf-c63d1023c148 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:53.674962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-26d5a2c9-5a8e-4abb-a6cf-c63d1023c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:53.805093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 699/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:53.851580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:53.853755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:53.952635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:54.032771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a5a9-bdae-41cf-9799-0dad4efa7486 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:54.177741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:54.178543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:54.178694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:54.178971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:54.180683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:54.244991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:54.318932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:54.320585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552cc6e-5c26-4c39-89a1-0d7d4f1d2d96 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:54.343594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 686/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:57.028176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:57.028774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:57.028774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:57.030114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 700/1386] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:57.041263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87979-7877-4da6-bbd4-c8d32f1a2472 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:57.041820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87979-7877-4da6-bbd4-c8d32f1a2472 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:57.041909 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87979-7877-4da6-bbd4-c8d32f1a2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:57.141494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e2a87979-7877-4da6-bbd4-c8d32f1a2472 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:57.142756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e2a87979-7877-4da6-bbd4-c8d32f1a2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:57.262185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 687/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:57.319706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:57.321285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:57.402919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:57.492418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c5d9c-1abb-4065-92a6-8f2cd7c8a4f4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:57.627929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:57.628615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:57.628954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:57.629208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:57.631001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:57.677305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:57.744461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:57.746770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f8ff9-dfea-443d-b6ec-043d30e67a72 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:57.767749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 701/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:08:00.026420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.027013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.027013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.028857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 688/1389] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:00.034791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c738c5-5cc1-4fed-8510-d5e6458009dc None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.035351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c738c5-5cc1-4fed-8510-d5e6458009dc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.035468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c738c5-5cc1-4fed-8510-d5e6458009dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.156146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c9c738c5-5cc1-4fed-8510-d5e6458009dc None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:00.158164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c9c738c5-5cc1-4fed-8510-d5e6458009dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.285638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 702/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:00.334678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:00.336598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.358150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd490-fd90-4fef-8d9a-30cedad17de2 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.358572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd490-fd90-4fef-8d9a-30cedad17de2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.359079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd490-fd90-4fef-8d9a-30cedad17de2 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.360722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 703/1391] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:00.366928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f6d6-616d-48f0-bb93-591fce2d4132 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.367218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f6d6-616d-48f0-bb93-591fce2d4132 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.367503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f6d6-616d-48f0-bb93-591fce2d4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.378806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:00.384909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:00.455963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8666f6d6-616d-48f0-bb93-591fce2d4132 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:00.457106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8666f6d6-616d-48f0-bb93-591fce2d4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.526599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95b48b-ad9c-457e-a3ac-07999979d32e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:00.573654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 704/1392] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:08:00.632718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188e29-8e7b-4216-9031-ebb8e3a3a0f1 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.633013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188e29-8e7b-4216-9031-ebb8e3a3a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.633472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188e29-8e7b-4216-9031-ebb8e3a3a0f1 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.634907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 705/1393] 10.222.0.60 () {54 vars in 962 bytes} [Mon Jul 11 14:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:08:00.640468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016067-b4cb-44af-896c-450c42ec26dd None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.640760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016067-b4cb-44af-896c-450c42ec26dd None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.641040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016067-b4cb-44af-896c-450c42ec26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.643180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:00.660042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:00.660707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:00.660995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:00.661264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:00.663014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.736225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7c016067-b4cb-44af-896c-450c42ec26dd None None] MFA Rules not processed for user `8f04bae4e4cd42b48ff4b6f351fa1bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:00.738317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7c016067-b4cb-44af-896c-450c42ec26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.772974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:00.774659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:00.787020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:00.795700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 689/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:00.839408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 706/1395] 10.222.0.60 () {58 vars in 1059 bytes} [Mon Jul 11 14:08:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:08:00.848700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:00.850040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:00.935462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd457-fc35-44da-bdec-b616e88ab574 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:00.983838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:01.028888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:01.031316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:01.031316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:01.031316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:01.031651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:01.179921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:01.181378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b206e6-9110-4751-8940-d389e28c8857 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:01.203784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 690/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:02.227193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66db3d-db2b-4b1f-ab86-04378608359d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:02.227774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66db3d-db2b-4b1f-ab86-04378608359d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:02.228208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66db3d-db2b-4b1f-ab86-04378608359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:02.331464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3b66db3d-db2b-4b1f-ab86-04378608359d None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:02.332766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3b66db3d-db2b-4b1f-ab86-04378608359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:02.435486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 707/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:02.488485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:02.489519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:02.489519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:02.490801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 691/1398] 10.222.0.60 () {54 vars in 942 bytes} [Mon Jul 11 14:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:02.499019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1359b-0390-4a52-9222-3bb7d81c353f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:02.499579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1359b-0390-4a52-9222-3bb7d81c353f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:02.500031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1359b-0390-4a52-9222-3bb7d81c353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:02.564333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:02.584762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-15f1359b-0390-4a52-9222-3bb7d81c353f None None] MFA Rules not processed for user `d459c85484c843f9ad25f90d76d0a634`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:02.585939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-15f1359b-0390-4a52-9222-3bb7d81c353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:02.702219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 708/1399] 10.222.0.60 () {58 vars in 1039 bytes} [Mon Jul 11 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:02.711767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:02.713630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:02.810639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:02.881816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da43c-f524-4844-a2a2-a44df61fabcf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:02.996187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:02.996886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:02.997172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:02.997441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:02.999176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:03.071144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:03.102562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:03.104290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061eecc-440c-4394-b879-62c18c68e7fe service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:03.116784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 692/1400] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:08:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:08:03.198731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:03.199841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:03.200537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:03.202007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 709/1401] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:08:03.207604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b438b-ec70-4ba6-aadf-d6ff30baa6e1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:03.207902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b438b-ec70-4ba6-aadf-d6ff30baa6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:03.208187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b438b-ec70-4ba6-aadf-d6ff30baa6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:03.281175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ca7b438b-ec70-4ba6-aadf-d6ff30baa6e1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:03.282447 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca7b438b-ec70-4ba6-aadf-d6ff30baa6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:03.390146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 693/1402] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:03.437063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:03.438648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:03.614035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:03.706869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb59fb7-4746-42f8-be61-2a5cecc79ea0 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:03.953239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:03.954112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:03.954520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:03.954919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:03.956727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:04.062974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:04.089288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:04.093416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b28f-536c-451d-a672-10e2760a1749 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:04.117997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 710/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:06.610173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:06.611115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:06.611115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:06.613983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 694/1404] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:08:06.618100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f5e-265d-4975-aeda-2b4f4ec368f6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:06.618911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f5e-265d-4975-aeda-2b4f4ec368f6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:06.618911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f5e-265d-4975-aeda-2b4f4ec368f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:06.703409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-958c9f5e-265d-4975-aeda-2b4f4ec368f6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:06.704678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-958c9f5e-265d-4975-aeda-2b4f4ec368f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:06.835888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 711/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:06.884497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:06.886223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:06.985924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:07.151189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fc3ad-d5a2-4bbb-b963-61e694bc28dd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:07.342119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:07.349173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:07.349173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:07.349173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:07.349173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:07.364548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:07.501931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:07.503548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0827e-b797-4ccb-8507-779e72eafa5e service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:07.530748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 695/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:09.892213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:09.892833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:09.893113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:09.897892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 712/1407] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:08:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:09.905869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f0e6-1a5f-4de1-9ddf-29cbc2c4d1a7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:09.905869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f0e6-1a5f-4de1-9ddf-29cbc2c4d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:09.905869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f0e6-1a5f-4de1-9ddf-29cbc2c4d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:10.038110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d50f0e6-1a5f-4de1-9ddf-29cbc2c4d1a7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:10.039485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d50f0e6-1a5f-4de1-9ddf-29cbc2c4d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:10.154599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:10.169560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 696/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:10.239005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:10.239005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:10.320702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:10.473982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b253c6-642f-4c56-8134-5f4b192eec2a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:10.622692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:10.623345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:10.623649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:10.623934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:10.625643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:10.748021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:10.749517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a0bf4-ac9f-449a-9a29-6f1ba33097b7 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:10.771055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 713/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:10.922001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:20.442722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:20.994848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=41 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:27.231249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139c80-8628-43f1-92cd-0866d8716d3e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:27.231776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139c80-8628-43f1-92cd-0866d8716d3e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:27.231776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139c80-8628-43f1-92cd-0866d8716d3e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:27.233403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 697/1410] 10.222.0.60 () {54 vars in 918 bytes} [Mon Jul 11 14:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:27.238554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6be8be-bc7e-4a86-8f58-5ac13a1a7fa5 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:27.238983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6be8be-bc7e-4a86-8f58-5ac13a1a7fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:27.239116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6be8be-bc7e-4a86-8f58-5ac13a1a7fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:27.319710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3f6be8be-bc7e-4a86-8f58-5ac13a1a7fa5 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:27.320992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3f6be8be-bc7e-4a86-8f58-5ac13a1a7fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:27.432657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 714/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Jul 11 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:27.446781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6499a-1be7-42f3-812d-5a089b78897a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:27.447064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6499a-1be7-42f3-812d-5a089b78897a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:27.447342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6499a-1be7-42f3-812d-5a089b78897a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:27.448692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 698/1412] 10.222.0.60 () {54 vars in 918 bytes} [Mon Jul 11 14:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:27.453836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f787b-f72b-40f6-af3d-61fb9cd6ca85 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:27.454147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f787b-f72b-40f6-af3d-61fb9cd6ca85 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:27.454424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f787b-f72b-40f6-af3d-61fb9cd6ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:27.531403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:27.534845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c24f787b-f72b-40f6-af3d-61fb9cd6ca85 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:27.536056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c24f787b-f72b-40f6-af3d-61fb9cd6ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:27.654310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 715/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Jul 11 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:30.217554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:30.218142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:30.218142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:30.219391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:30.225219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d608-0a76-4e7f-8a20-ebf511d1fddc None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:30.225664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d608-0a76-4e7f-8a20-ebf511d1fddc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:30.225871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d608-0a76-4e7f-8a20-ebf511d1fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:30.293420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2283d608-0a76-4e7f-8a20-ebf511d1fddc None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:30.294727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2283d608-0a76-4e7f-8a20-ebf511d1fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:30.351527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:30.393401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:30.436518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:30.438173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:30.591917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fb671-7cc4-49a0-b199-5922a4c08a98 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:30.669050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:30.711979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:30.712634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:30.712921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:30.713200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:30.714898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:30.806594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:30.808206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97959d6-8d70-4aa2-a133-4b106ca68b66 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:30.828572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 700/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:31.772749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:31.773345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:31.773345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:31.774768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:31.780647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f13b3-befd-4a93-958d-6f010ed3b4c3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:31.781077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f13b3-befd-4a93-958d-6f010ed3b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:31.781191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f13b3-befd-4a93-958d-6f010ed3b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:31.865083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-751f13b3-befd-4a93-958d-6f010ed3b4c3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:31.866352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-751f13b3-befd-4a93-958d-6f010ed3b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:31.901191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:31.974340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:32.125051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:32.126563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:32.276351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ee815-76ac-4241-bdbe-6a131b5ac270 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:32.318128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:32.394206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:32.394779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:32.395068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:32.395351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:32.397026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:32.488302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:32.489989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e30f-cb55-490c-ac75-907dfa383e45 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:32.509684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 718/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:33.443899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:33.444468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:33.444468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:33.445919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:33.451444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4799e-3b60-4e6e-b57c-e2744023e5df None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:33.451893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4799e-3b60-4e6e-b57c-e2744023e5df None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:33.452203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4799e-3b60-4e6e-b57c-e2744023e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:33.510406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:33.532641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8ba4799e-3b60-4e6e-b57c-e2744023e5df None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:33.533890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8ba4799e-3b60-4e6e-b57c-e2744023e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:33.635417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:33.792817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:33.795098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:33.945280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07f20a-7e67-483f-a392-ff6ca8eafced None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:33.959699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:34.064419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:34.064978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:34.065262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:34.065562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:34.067376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:34.160449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:34.162090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62bf31-6547-4555-a388-a9f245c54709 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:34.180183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 703/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:35.054919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:35.055456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:35.055592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:35.056897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:35.062757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301165-0ba4-497b-b798-f5c5d8a87df1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:35.063217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301165-0ba4-497b-b798-f5c5d8a87df1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:35.063316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301165-0ba4-497b-b798-f5c5d8a87df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:35.083305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:35.143308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-67301165-0ba4-497b-b798-f5c5d8a87df1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:35.144431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-67301165-0ba4-497b-b798-f5c5d8a87df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:35.243531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:35.397146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:35.398640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:35.519944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:35.556704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e14a-2377-43d5-81a9-7d602dac7b0b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:35.672081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:35.672659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:35.673011 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:35.673223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:35.674925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:35.754652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:35.768710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:35.772031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a516-4f13-4e15-bcdf-82f5e8f87959 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:35.789493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 721/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:36.659411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:36.659987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:36.659987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:36.661342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:36.666251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456127-e486-4008-9d63-a981088864b0 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:36.666699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456127-e486-4008-9d63-a981088864b0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:36.666796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456127-e486-4008-9d63-a981088864b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:36.743709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-dc456127-e486-4008-9d63-a981088864b0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:36.744824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dc456127-e486-4008-9d63-a981088864b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:36.842275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:36.992467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:36.994231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:37.079859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:37.144400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ae0fb-f65e-4aab-9c6d-1e0e9d104741 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:37.269557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:37.270296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:37.270296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:37.270849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:37.272319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:37.327074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:37.368288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:37.369951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca7e3b-276b-443e-a704-41cc528fce06 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:37.389211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 706/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:38.339505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:38.340091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:38.340091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:38.341993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:38.347372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e3de9-5f35-4ece-a745-62ac122eaca2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:38.347852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e3de9-5f35-4ece-a745-62ac122eaca2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:38.347995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e3de9-5f35-4ece-a745-62ac122eaca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:38.425268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5c0e3de9-5f35-4ece-a745-62ac122eaca2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:38.436421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5c0e3de9-5f35-4ece-a745-62ac122eaca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:38.532449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:38.688972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:38.690449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:38.741977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:38.843660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3bb3-0a93-4fc3-b21c-7e1ea1c833a4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:38.966245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:38.966809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:38.967089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:38.967360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:38.969009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:38.976270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:39.058244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:39.060467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764dc7-67d0-414a-bee1-fc768ea3d66b service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:39.079116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 724/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:39.957425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:39.958048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:39.958048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:39.959401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:39.964837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364092e-3a2e-4ebc-b5da-7701da8a285c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:39.965266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364092e-3a2e-4ebc-b5da-7701da8a285c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:39.965403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364092e-3a2e-4ebc-b5da-7701da8a285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:40.043543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f364092e-3a2e-4ebc-b5da-7701da8a285c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:40.044980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f364092e-3a2e-4ebc-b5da-7701da8a285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:40.116520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:40.146553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:40.298810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:40.300351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:40.319385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:40.454250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2a2d8-9361-420c-b631-21df01152ab2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:40.543726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:40.570204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:40.570841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:40.571123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:40.571401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:40.573877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:40.663544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:40.665139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617283d-4d20-41ca-aede-3391e07f097e service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:40.687090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 709/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:41.574372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:41.574956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:41.574956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:41.576819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:41.581986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab056-1ae1-49da-bd6c-34ec45a2221a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:41.582482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab056-1ae1-49da-bd6c-34ec45a2221a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:41.582611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab056-1ae1-49da-bd6c-34ec45a2221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:41.658475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-302ab056-1ae1-49da-bd6c-34ec45a2221a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:41.659687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-302ab056-1ae1-49da-bd6c-34ec45a2221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:41.700917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:41.760941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:41.911338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:41.912866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:42.064236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dfc95-8d21-4ad3-882f-c240dfe1414d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:42.124486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:42.188824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:42.189453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:42.189782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:42.190058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:42.191820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:42.288650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:42.290331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1cf38-ea9c-461a-8554-ca3906ef9f73 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:42.309433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 727/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:43.208604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:43.209142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:43.209142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:43.210498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:43.215436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04060ed-7468-4511-ab96-abebf1f697a6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:43.215844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04060ed-7468-4511-ab96-abebf1f697a6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:43.215991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04060ed-7468-4511-ab96-abebf1f697a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:43.292349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f04060ed-7468-4511-ab96-abebf1f697a6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:43.293642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f04060ed-7468-4511-ab96-abebf1f697a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:43.296538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:43.394393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:43.546364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:43.547966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:43.697062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432eecf9-56e0-462b-b888-ec66521c7de0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:43.727547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:43.814317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:43.814883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:43.815168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:43.815444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:43.817095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:43.907786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:43.909395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c38a5-e8bd-4a34-9dd4-85bc2e67220a service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:43.928670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 712/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:45.941928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:45.942493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:45.942493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:45.943831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:45.949292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a13078-623b-4909-91b9-ce23127b968b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:45.949737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a13078-623b-4909-91b9-ce23127b968b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:45.949911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a13078-623b-4909-91b9-ce23127b968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:45.989933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:46.015128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d9a13078-623b-4909-91b9-ce23127b968b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:46.016427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d9a13078-623b-4909-91b9-ce23127b968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:46.117521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:46.158056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:46.159666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:46.268625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1539-ea37-4029-8932-f49ad67b1dc8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:46.301469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:46.344349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:46.345008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:46.345326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:46.345889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:46.347550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:46.459514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:46.460876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de861-c5f5-4d82-98d4-0281fa666f0c service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:46.480750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 730/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:48.693166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:48.693793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:48.693793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:48.695141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:48.700587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8475b-e0af-4265-8657-8e21c4178945 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:48.701035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8475b-e0af-4265-8657-8e21c4178945 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:48.701145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8475b-e0af-4265-8657-8e21c4178945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:48.765546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a8d8475b-e0af-4265-8657-8e21c4178945 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:48.766779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a8d8475b-e0af-4265-8657-8e21c4178945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:48.779569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:48.866980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:48.907706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:48.909252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:49.014789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9bec-f549-4196-87cf-1c1d2bc969be None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:49.026644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:49.087297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:49.087951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:49.088231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:49.088510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:49.090196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:49.199530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:49.201029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce854d-cfc0-40af-b82b-5a4eda6d727c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:49.219781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 715/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:51.682557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:51.683159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:51.683159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:51.684490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:51.690335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ed15-88f9-47c6-a8e5-3fe293279e0e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:51.690772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ed15-88f9-47c6-a8e5-3fe293279e0e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:51.690894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ed15-88f9-47c6-a8e5-3fe293279e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:51.739043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:51.759549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3595ed15-88f9-47c6-a8e5-3fe293279e0e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:51.760806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3595ed15-88f9-47c6-a8e5-3fe293279e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:51.859704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:51.898632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:51.900322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:52.009510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f2945-1468-42ff-bcab-0a16ec43ebe6 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:52.049960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:52.084477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:52.085132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:52.085408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:52.085712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:52.087366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:52.198190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:52.199684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6850-30af-4e52-a719-961d28aeba0b service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:52.219305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 733/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:54.436901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:54.437482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:54.437482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:54.438904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:54.444416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b017bb-42c5-4ff1-a0de-10b3d65eba5d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:54.444898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b017bb-42c5-4ff1-a0de-10b3d65eba5d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:54.445007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b017bb-42c5-4ff1-a0de-10b3d65eba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:54.510738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a4b017bb-42c5-4ff1-a0de-10b3d65eba5d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:54.511962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a4b017bb-42c5-4ff1-a0de-10b3d65eba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:54.533160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:54.610143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:54.647634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:54.649332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:54.757650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4a6c-03ab-4799-9e84-16ce5fc4a1b7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:54.777244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:54.834508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:54.835165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:54.835450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:54.835729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:54.837509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:54.952856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:54.954336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0cd26-318a-4fad-9545-abae5f1c491f service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:54.972649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 718/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:57.046778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:57.047326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:57.047326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:57.048707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:57.054179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500ebe-5116-4787-bee8-9c29d74f5a13 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:57.054638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500ebe-5116-4787-bee8-9c29d74f5a13 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:57.054746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500ebe-5116-4787-bee8-9c29d74f5a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:57.117714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:57.120497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-13500ebe-5116-4787-bee8-9c29d74f5a13 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:57.121824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-13500ebe-5116-4787-bee8-9c29d74f5a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:57.221631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:08:57.259454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:57.261089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:57.366972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c275d5-fe7c-415d-a4bc-d400c8d9bc6e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:08:57.415879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:57.443928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:08:57.444666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:57.444977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:57.445302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:57.447090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:57.567353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:08:57.568965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223dd8b-663a-40f2-a93c-ed15019d1ed4 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:08:57.587497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 736/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:08:59.739699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:59.740300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:59.740300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:59.741748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:08:59.747416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cdd-4fb4-4d9b-a907-093ef61936ed None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:08:59.748366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cdd-4fb4-4d9b-a907-093ef61936ed None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:08:59.748652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cdd-4fb4-4d9b-a907-093ef61936ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:08:59.819368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-38938cdd-4fb4-4d9b-a907-093ef61936ed None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:08:59.820596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-38938cdd-4fb4-4d9b-a907-093ef61936ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:08:59.851298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:59.920344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:08:59.958552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:08:59.960102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:00.061822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a32b0-2dce-47fa-a5b3-7134eb5152cc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:00.089929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:00.138275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:00.139756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:00.140042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:00.140317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:00.142053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:00.256563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:00.258047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa4d0-7c38-45dd-91e7-3b2a8003f023 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:00.277188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 721/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:02.421679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:02.422346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:02.422346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:02.423615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:09:02.429346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3f6ed-793b-48d5-a3a4-b690e227c749 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:02.434781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3f6ed-793b-48d5-a3a4-b690e227c749 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:02.434781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3f6ed-793b-48d5-a3a4-b690e227c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:02.498475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2ef3f6ed-793b-48d5-a3a4-b690e227c749 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:02.499767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2ef3f6ed-793b-48d5-a3a4-b690e227c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:02.508814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:02.600160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:02.638593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:02.640153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:02.745012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14cf61-843e-4270-977c-a0e4bd930231 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:02.804244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:02.823152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:02.823815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:02.824102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:02.824385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:02.826769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:02.937123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:02.938638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353f644-24fc-43ef-8278-ae6c98c7581c service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:02.956851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 739/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:05.101651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:05.102157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:05.102157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:05.103512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:05.109448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02df8-fd27-4dea-ae6b-653f048fa983 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:05.109905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02df8-fd27-4dea-ae6b-653f048fa983 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:05.110074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02df8-fd27-4dea-ae6b-653f048fa983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:05.176668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4ad02df8-fd27-4dea-ae6b-653f048fa983 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:05.178050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4ad02df8-fd27-4dea-ae6b-653f048fa983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:05.218739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:05.280063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:05.317177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:05.318736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:05.422735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b562af-71d4-4c24-bfbf-30407a48fc7e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:05.461109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:05.501022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:05.501755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:05.502057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:05.502567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:05.504779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:05.617086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:05.618564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a328-06af-4373-b1e5-d7c79cd99eb8 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:05.637144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 724/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:07.706707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:07.707282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:07.707404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:07.708724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:07.714131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c845b-7660-4281-999b-d681a3dac231 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:07.714545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c845b-7660-4281-999b-d681a3dac231 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:07.714687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c845b-7660-4281-999b-d681a3dac231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:07.781444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bc1c845b-7660-4281-999b-d681a3dac231 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:07.782695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bc1c845b-7660-4281-999b-d681a3dac231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:07.801935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:07.883610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:07.920297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:07.921932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:08.027621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfb9a5-d616-4c39-9458-c479187353ac None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:08.095089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:08.101862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:08.102514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:08.102796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:08.103073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:08.104861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:08.338849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:08.340333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ad641-b6b7-418f-944f-3047b3cef044 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:08.361191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 742/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:10.407342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:10.407891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:10.407891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:10.409263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:10.414623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e47d-63d9-4287-bad7-efec8921ac21 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:10.415050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e47d-63d9-4287-bad7-efec8921ac21 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:10.415165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e47d-63d9-4287-bad7-efec8921ac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:10.480433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8bc8e47d-63d9-4287-bad7-efec8921ac21 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:10.481736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8bc8e47d-63d9-4287-bad7-efec8921ac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:10.532681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:10.583451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:10.621058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:10.623315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:10.736703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935dc3-05eb-4fd3-b6bc-fe2fe1ceaebe None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:10.785363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:10.813825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:10.814483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:10.814766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:10.815040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:10.817459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:10.933675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:10.935940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f062-2642-4610-8bfd-7a5055c157e9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:10.954565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 727/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:20.581448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=22 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:20.952216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=66 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:31.053830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd019-7482-41e1-91c1-a2badb614366 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:31.054364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd019-7482-41e1-91c1-a2badb614366 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:31.054493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd019-7482-41e1-91c1-a2badb614366 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:31.055775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 744/1471] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:31.061844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2e11-cfc8-40d4-acdf-a9ecd4c9fe0e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:31.062344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2e11-cfc8-40d4-acdf-a9ecd4c9fe0e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:31.062439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2e11-cfc8-40d4-acdf-a9ecd4c9fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:31.139502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5a9d2e11-cfc8-40d4-acdf-a9ecd4c9fe0e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:31.140747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5a9d2e11-cfc8-40d4-acdf-a9ecd4c9fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:31.238864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 728/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:31.331031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:31.331308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:31.331582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:31.332945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 745/1473] 10.222.0.60 () {54 vars in 962 bytes} [Mon Jul 11 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:09:31.338368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782aaf4-3c5e-4e38-b043-1b3df8ffd7fd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:31.338745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782aaf4-3c5e-4e38-b043-1b3df8ffd7fd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:31.339089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782aaf4-3c5e-4e38-b043-1b3df8ffd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:31.419620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5782aaf4-3c5e-4e38-b043-1b3df8ffd7fd None None] MFA Rules not processed for user `8f04bae4e4cd42b48ff4b6f351fa1bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:31.420864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5782aaf4-3c5e-4e38-b043-1b3df8ffd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:31.442657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:31.504549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 729/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Mon Jul 11 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:31.513175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:31.514739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:31.654066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e49e5-e17c-49cd-9f88-b232c1747d48 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:31.740361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:31.741033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:31.741317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:31.741601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:31.743419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:31.810791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:31.872832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:31.874323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78734b0a-513d-4001-a969-9fb0c36034a9 service glance] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:31.894150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 746/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:34.103120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:34.103690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:34.103690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:34.106588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 730/1476] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:34.112653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd3d9-c48d-4f8a-9e13-bf10510bdcb8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:34.113140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd3d9-c48d-4f8a-9e13-bf10510bdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:34.113331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd3d9-c48d-4f8a-9e13-bf10510bdcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:34.186110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-84efd3d9-c48d-4f8a-9e13-bf10510bdcb8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:34.187291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-84efd3d9-c48d-4f8a-9e13-bf10510bdcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:34.291416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 747/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:34.316650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:34.318355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:34.451147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f248c-02e0-42af-8959-b7ae4746ee70 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:34.506826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:34.555565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:34.556234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:34.556521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:34.556801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:34.557533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:34.560122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:34.560122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:09:34.560122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:09:34.561323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072030a2-0fc2-4b18-a1af-72884927c3a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:34.584068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 731/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Jul 11 14:09:34 2022] GET /identity/v3/projects => generated 2553 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:09:36.789935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:36.790473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:36.790473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:36.791784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 748/1479] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:36.798380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432182-9425-4f16-bc7f-bfbb4bf3aa43 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:36.798883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432182-9425-4f16-bc7f-bfbb4bf3aa43 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:36.798983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21432182-9425-4f16-bc7f-bfbb4bf3aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:36.866511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-21432182-9425-4f16-bc7f-bfbb4bf3aa43 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:36.867753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-21432182-9425-4f16-bc7f-bfbb4bf3aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:36.974450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 732/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:09:37.018351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:37.019531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:37.029882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:37.174811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4219e0-9ef6-45a9-a09d-de2b5693ac39 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:37.262798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:37.297424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:37.298113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:37.298401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:37.298680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:37.300410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:37.394067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:37.395732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62953f7d-71cb-436f-9959-5260407ad837 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:37.413821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 749/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:39.726188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:39.726773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:39.726773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:39.728134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 733/1482] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:39.734709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bed3a-9a02-46ca-bd62-0f4fbd0f54e7 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:39.735278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bed3a-9a02-46ca-bd62-0f4fbd0f54e7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:39.735545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bed3a-9a02-46ca-bd62-0f4fbd0f54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:39.811899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1e1bed3a-9a02-46ca-bd62-0f4fbd0f54e7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:39.813192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1e1bed3a-9a02-46ca-bd62-0f4fbd0f54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:39.884534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:39.942539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 750/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:39.982206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:39.983818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:40.010271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:40.100048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb956-8bd9-4e69-9dc0-9a1c5c9c3b8c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:40.190199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:40.190891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:40.191175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:40.191452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:40.193352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:40.280968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:40.327498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:40.329200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ec1f-c897-4b32-818b-dbe9fe1bfaf0 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:40.351828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 734/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:42.545302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:42.546291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:42.546291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:42.547820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 751/1485] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:42.553729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cb49-8564-4f4e-bc13-d70b4a20d743 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:42.554281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cb49-8564-4f4e-bc13-d70b4a20d743 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:42.554281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4cb49-8564-4f4e-bc13-d70b4a20d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:42.626578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-17d4cb49-8564-4f4e-bc13-d70b4a20d743 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:42.627838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-17d4cb49-8564-4f4e-bc13-d70b4a20d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:42.733151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 735/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:42.773107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:42.774698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:42.901196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe002f-dcd1-4143-b21d-ccb9dc051745 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:42.984791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:42.986628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:42.987286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:42.987568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:42.987845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:42.989503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:43.105955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:43.107415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bebd5-9f67-4abf-abd1-9068cc987d98 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:43.126666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 752/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:45.372180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:45.372802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:45.373098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:45.375494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 736/1488] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:45.381503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967bb0-7672-4fd5-9817-dd64c48d4087 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:45.382034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967bb0-7672-4fd5-9817-dd64c48d4087 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:45.382202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967bb0-7672-4fd5-9817-dd64c48d4087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:45.458603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-df967bb0-7672-4fd5-9817-dd64c48d4087 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:45.459846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-df967bb0-7672-4fd5-9817-dd64c48d4087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:45.538613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:45.590589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 753/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:09:45.634855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:45.637808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:45.688919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:45.769796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99a63-3ab3-408d-86d7-54a3a6fa18dd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:45.858468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:45.859125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:45.859410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:45.859694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:45.861395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:45.970900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:46.005121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:46.007589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693d70-3dee-4b44-ae57-9db7aae5f685 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:46.029912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 737/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:48.685537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:48.686250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:48.686250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:48.687501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 754/1491] 10.222.0.60 () {54 vars in 926 bytes} [Mon Jul 11 14:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:48.694268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f47e-06ba-4bc8-a9f9-e49d7efca3b9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:48.694814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f47e-06ba-4bc8-a9f9-e49d7efca3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:48.694814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f47e-06ba-4bc8-a9f9-e49d7efca3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:48.768196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f283f47e-06ba-4bc8-a9f9-e49d7efca3b9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:48.769449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f283f47e-06ba-4bc8-a9f9-e49d7efca3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:48.875928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 738/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Jul 11 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:48.916372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:48.919887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:49.050248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d366-2993-422a-8fa9-69af5233a516 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:49.131596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:49.132268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:49.132554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:49.132835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:49.134582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:49.148506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:49.283145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:49.284624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e802582-5aa4-40c2-adf8-204f953a70ec service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:49.306622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 755/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:58.874001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=82 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:59.303791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=50 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:29.066632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:29.067496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:29.067687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:29.142162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:29.143375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:29.241185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 739/1494] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:29.249841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:29.250360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:29.250468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:29.337820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:29.339319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:29.441760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 756/1495] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:29.447428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:29.448656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:29.460539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a4b0-1980-4cb6-a22b-a791e28e1b05 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:29.526237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:29.559814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:29.560482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:29.560764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:29.561040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:29.561784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:11:29.562089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:29.563113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:29.563113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:11:29.563113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:11:29.563990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:29.576473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 740/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:11:29.584851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:29.594481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51659c95-0226-4e6c-b0b1-c54f4337700d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:29.656379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:29.690776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:29.691732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:29.692225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:29.692838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:29.693552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:29.695997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:29.695997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:11:29.695997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:11:29.697179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:29.819224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 757/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:11:29 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:11:29.824053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:29.825650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:29.862913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712dec8-ed4f-4b62-9362-038206c913c6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:29.962120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:29.962801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:29.963338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:29.963614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:29.964306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:29.965324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:29.965324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:11:29.965324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:11:29.966551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:30.153597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 741/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:11:29 2022] POST /identity/v3/users => generated 290 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:11:30.157601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:30.159254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:30.222040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36e81-2582-4993-a5d8-07af1f8fa39b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:30.308299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:30.318579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:30.321334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.321334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.321334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.321334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:30.321734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:30.321734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:11:30.321734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:11:30.322442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:30.334775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 758/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:11:30.339934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:30.341501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:30.353650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42e0d-1198-42c7-950b-7651e09f2a8f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:30.378707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:30.449187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:30.449812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.450083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.450355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.451076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:30.452099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:30.452099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:11:30.452099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:11:30.452976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22696a-4135-4825-b87f-e79f071d0d22 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:30.466604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 742/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:11:30.471002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:30.473026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:30.511334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd807-22bd-4f23-8e24-ec49a4d0a340 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:30.607495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:30.608393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.608681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.608961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] PATH_INFO: `/v3/projects/95aa30f205e1483f8ba9c45b2061d9e9/users/b1c6750f0e8f4e70a5b7750fe067e46a/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.631871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aa30f205e1483f8ba9c45b2061d9e9, user_id=b1c6750f0e8f4e70a5b7750fe067e46a, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:30.633057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:30.633057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:11:30.633057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:11:30.635040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4de064-edcb-4dd4-9d1f-6a5cd4f274e7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:30.712220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 759/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:11:30 2022] PUT /identity/v3/projects/95aa30f205e1483f8ba9c45b2061d9e9/users/b1c6750f0e8f4e70a5b7750fe067e46a/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:11:30.724669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1daf4-83c1-467f-925d-ba0701030a0b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.724921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1daf4-83c1-467f-925d-ba0701030a0b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.725204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1daf4-83c1-467f-925d-ba0701030a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.786508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e6d1daf4-83c1-467f-925d-ba0701030a0b None None] MFA Rules not processed for user `b1c6750f0e8f4e70a5b7750fe067e46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:30.787744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6d1daf4-83c1-467f-925d-ba0701030a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:30.872601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 743/1502] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:30.885800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.886095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.886380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.887770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 760/1503] 10.222.0.60 () {54 vars in 963 bytes} [Mon Jul 11 14:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:30.892617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98956d-a13a-44ad-a51e-d53c7faaadc5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.892906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98956d-a13a-44ad-a51e-d53c7faaadc5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.893195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98956d-a13a-44ad-a51e-d53c7faaadc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.925717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:30.971220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7e98956d-a13a-44ad-a51e-d53c7faaadc5 None None] MFA Rules not processed for user `88ad61a2fb834e31b4a6f6df2f023e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:30.972362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7e98956d-a13a-44ad-a51e-d53c7faaadc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:31.050485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 744/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Mon Jul 11 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:31.058250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:31.059961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:31.117012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:31.175299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53546-2ce9-4112-94a2-006f8ce546a5 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:31.260288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:31.260867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:31.261149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:31.261422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:31.263203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:31.369623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:31.371144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:31.374814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:31.390355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 761/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:31.433274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec43a1-f7db-4c2a-932f-0b056343606c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:31.433778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec43a1-f7db-4c2a-932f-0b056343606c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:31.433894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec43a1-f7db-4c2a-932f-0b056343606c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:31.435151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 745/1506] 10.222.0.60 () {52 vars in 829 bytes} [Mon Jul 11 14:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:31.439022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:31.440278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:31.545535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9127-d05f-4e94-9202-8270a75f134c service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:31.646131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:31.647004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:31.647283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:31.647558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] PATH_INFO: `/v3/users/b1c6750f0e8f4e70a5b7750fe067e46a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:31.660580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c6750f0e8f4e70a5b7750fe067e46a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:31.661646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:31.661646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:11:31.661646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:11:31.662852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:31.673250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:31.848657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c6750f0e8f4e70a5b7750fe067e46a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:31.864860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c6750f0e8f4e70a5b7750fe067e46a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:31.865473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c6750f0e8f4e70a5b7750fe067e46a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:31.887952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c6750f0e8f4e70a5b7750fe067e46a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:31.945693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c6750f0e8f4e70a5b7750fe067e46a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:31.951865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 762/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:11:31 2022] DELETE /identity/v3/users/b1c6750f0e8f4e70a5b7750fe067e46a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:11:31.956470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:31.959523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:31.959523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:32.023621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:32.024854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:32.222457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:32.236023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 746/1508] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:32.246498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:32.247756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:32.358430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b74a9-fb5d-4a82-8adf-df4f4e1c4e02 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:32.413048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:32.432901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:32.433565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:32.433881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:32.434161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:32.435839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:32.550286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:32.551733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c36c5-023a-4ebc-af67-bb29c59f1dc9 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:32.571045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 763/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:33.093521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:33.094797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:33.106845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659ad2-f2c4-4280-bd85-3c1541c30eb3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:33.207632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:33.208537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:33.208820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:33.209095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] PATH_INFO: `/v3/projects/95aa30f205e1483f8ba9c45b2061d9e9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:33.221065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aa30f205e1483f8ba9c45b2061d9e9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:33.222191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:33.222191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:11:33.222191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:11:33.223384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:33.355544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aa30f205e1483f8ba9c45b2061d9e9', 'request_id': 'req-f62aba43-ff39-4e57-abb9-e7de5a8e1206'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:33.363601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aa30f205e1483f8ba9c45b2061d9e9', 'request_id': 'req-f62aba43-ff39-4e57-abb9-e7de5a8e1206'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:33.434087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aa30f205e1483f8ba9c45b2061d9e9', 'request_id': 'req-f62aba43-ff39-4e57-abb9-e7de5a8e1206'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:33.464571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] The token cache is being invalidate because project 95aa30f205e1483f8ba9c45b2061d9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:11:33.464858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:33.465287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f62aba43-ff39-4e57-abb9-e7de5a8e1206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:11:33.466825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 747/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:11:33 2022] DELETE /identity/v3/projects/95aa30f205e1483f8ba9c45b2061d9e9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:11:42.568331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=62 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:43.462211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:23.710422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.711023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.711023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.712352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:23.717462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57af4-fad6-4a2d-abc0-b38d3f867136 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.717918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57af4-fad6-4a2d-abc0-b38d3f867136 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.718191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57af4-fad6-4a2d-abc0-b38d3f867136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.803857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a8f57af4-fad6-4a2d-abc0-b38d3f867136 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:23.805219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a8f57af4-fad6-4a2d-abc0-b38d3f867136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:23.916933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:24.074159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.076364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:24.199269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6784269-247c-449a-b1e0-73a4a7516d73 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.204901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.205607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.205926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.206222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.215516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.217143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87b817-76c7-42e6-b5ab-b975609652f2 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.228193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 765/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:24.985619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b7f6-f4ef-4679-980e-57259eb61f12 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.986187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b7f6-f4ef-4679-980e-57259eb61f12 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.986187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b7f6-f4ef-4679-980e-57259eb61f12 None None] PATH_INFO: `/v3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.987629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 749/1514] 10.222.0.69 () {54 vars in 925 bytes} [Mon Jul 11 14:13:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:24.993873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d313b-b997-41b8-80fc-ae9265155064 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.994329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d313b-b997-41b8-80fc-ae9265155064 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.994640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d313b-b997-41b8-80fc-ae9265155064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.062616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0c2d313b-b997-41b8-80fc-ae9265155064 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:25.063879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0c2d313b-b997-41b8-80fc-ae9265155064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:25.095560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbe8b4-a1a1-46fe-b1b1-eca3ee388fcd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.095915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbe8b4-a1a1-46fe-b1b1-eca3ee388fcd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.096399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbe8b4-a1a1-46fe-b1b1-eca3ee388fcd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.098142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 750/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:13:25.103215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.103492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.103768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.124441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:25.125680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:25.134331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 751/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:25.138349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:25.145127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 766/1517] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:25.286882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.300307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337290e7-38a7-4f9f-9b95-f68226f626c8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.305948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.306603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.306885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.307173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.316764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.318386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec6a6b-4230-461c-975a-03641adde91c service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.327969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 752/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:34.378967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5cae-f938-42a1-866a-a932bbbbeb05 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:34.379596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5cae-f938-42a1-866a-a932bbbbeb05 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:34.379596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5cae-f938-42a1-866a-a932bbbbeb05 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:34.380959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 767/1519] 10.222.0.60 () {54 vars in 960 bytes} [Mon Jul 11 14:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:34.387992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ff87-5f50-49f7-9ae2-0c8ff8e96367 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:34.388682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ff87-5f50-49f7-9ae2-0c8ff8e96367 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:34.388941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59ff87-5f50-49f7-9ae2-0c8ff8e96367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:34.410608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ab59ff87-5f50-49f7-9ae2-0c8ff8e96367 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:34.411996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab59ff87-5f50-49f7-9ae2-0c8ff8e96367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:34.421326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 753/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Mon Jul 11 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:34.429438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5cae-f938-42a1-866a-a932bbbbeb05 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:34.444357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5cae-f938-42a1-866a-a932bbbbeb05 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:34.449680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:34.450353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:34.450640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:34.450925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:34.462000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:34.463691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad5fc4-061d-4e22-b89c-3d9d209c1bd2 service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:34.476146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 768/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:36.622878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe54e7-7f1a-46e5-93e0-068467fe36a4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.623480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe54e7-7f1a-46e5-93e0-068467fe36a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.623480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe54e7-7f1a-46e5-93e0-068467fe36a4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.624791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:36.631051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e26ec-362f-475d-9614-9a490e753650 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.633767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e26ec-362f-475d-9614-9a490e753650 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.633767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e26ec-362f-475d-9614-9a490e753650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.651358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-202e26ec-362f-475d-9614-9a490e753650 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:36.652648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-202e26ec-362f-475d-9614-9a490e753650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:36.661407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:36.821081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe54e7-7f1a-46e5-93e0-068467fe36a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:36.837120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe54e7-7f1a-46e5-93e0-068467fe36a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:36.842838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:36.843489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.843772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.844049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.854095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:36.855723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1bbc-1867-4fc0-8686-9c52c20d53f5 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:36.867360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 755/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:37.722951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-6597-4e3e-a771-9233dc5f05ef None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.723506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-6597-4e3e-a771-9233dc5f05ef None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.723506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-6597-4e3e-a771-9233dc5f05ef None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.724926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:37.730180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d317-8a18-4fe3-8d55-570dbba74955 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.730658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d317-8a18-4fe3-8d55-570dbba74955 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.730769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d317-8a18-4fe3-8d55-570dbba74955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.749085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2513d317-8a18-4fe3-8d55-570dbba74955 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:37.750438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2513d317-8a18-4fe3-8d55-570dbba74955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:37.759195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:37.915772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c7a0-6597-4e3e-a771-9233dc5f05ef None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:37.931266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c7a0-6597-4e3e-a771-9233dc5f05ef None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:37.936764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:37.937419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.937745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.938028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.947587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:37.949181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a4394-ebaf-4c14-9119-298fed0beda7 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:37.959423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 771/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:13:42.405342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.405949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.405949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.407968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:42.413703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ee16-842f-4ea4-87c2-27ca3ee555ca None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.414225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ee16-842f-4ea4-87c2-27ca3ee555ca None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.414323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ee16-842f-4ea4-87c2-27ca3ee555ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.432831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-62a9ee16-842f-4ea4-87c2-27ca3ee555ca None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:42.434094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-62a9ee16-842f-4ea4-87c2-27ca3ee555ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.442909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:42.526599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.528348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.562185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:42.618227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd3e9-699c-4dea-a259-a3d195576831 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.621662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.622312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.622598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.622874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.632447 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.633924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e89a0-5a30-4348-85dd-219b1a243c66 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.644634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 758/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:44.700239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202c6a-92c8-4157-ad20-bbf51b779735 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.700803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202c6a-92c8-4157-ad20-bbf51b779735 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.700803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202c6a-92c8-4157-ad20-bbf51b779735 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.702206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:44.707927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8ee8-68b2-40a5-9fc8-0075c8653eae None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.708385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8ee8-68b2-40a5-9fc8-0075c8653eae None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.708520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8ee8-68b2-40a5-9fc8-0075c8653eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.726134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-090d8ee8-68b2-40a5-9fc8-0075c8653eae None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:44.727347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-090d8ee8-68b2-40a5-9fc8-0075c8653eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.736792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:44.773082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13202c6a-92c8-4157-ad20-bbf51b779735 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.784201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13202c6a-92c8-4157-ad20-bbf51b779735 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.787816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.788462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.788752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.789029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.798907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.800359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a598-e778-4140-a99d-9ce1f71d952b service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.810260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 774/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.647263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.647816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.647816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.649198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:48.654709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2798f-16ba-4ddc-b7df-8d68edbf2018 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.655144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2798f-16ba-4ddc-b7df-8d68edbf2018 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.655262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2798f-16ba-4ddc-b7df-8d68edbf2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.674000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-97a2798f-16ba-4ddc-b7df-8d68edbf2018 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:48.675208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-97a2798f-16ba-4ddc-b7df-8d68edbf2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.683017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:48.994346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.996033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.076217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e81d2-4585-428b-b08b-275eb67cdbea None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.080832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.081777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.082066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.082345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.091830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.093287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11c178-7f7f-4599-a5d1-5ff1ac58d27d service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.103335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 761/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:51.169677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.170201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.170201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.171512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:51.177278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71377-50a1-4df7-aeab-92801abf7e9d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.177753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71377-50a1-4df7-aeab-92801abf7e9d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.177864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71377-50a1-4df7-aeab-92801abf7e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.196883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a9c71377-50a1-4df7-aeab-92801abf7e9d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:51.198127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a9c71377-50a1-4df7-aeab-92801abf7e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.206133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:51.509077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.510799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.523753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ec7f-e529-4ff1-8ae5-346c44c793eb None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.527308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.527942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.528230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.528511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.537710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.539144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bd707-c106-4945-8346-70c31412dcd5 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.549346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 777/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:01.190728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=66 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:01.544429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=34 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:27.638466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.639172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.639172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.671125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.672394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.681688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 763/1540] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:27.691032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef73bf-e056-4752-ba54-613320242166 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.691676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef73bf-e056-4752-ba54-613320242166 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.691676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef73bf-e056-4752-ba54-613320242166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.724418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-bfef73bf-e056-4752-ba54-613320242166 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.725718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bfef73bf-e056-4752-ba54-613320242166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.741887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 778/1541] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:27.746779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:27.753805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695deb-90d7-4f9d-a13d-3c4113a63399 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.756903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695deb-90d7-4f9d-a13d-3c4113a63399 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.756903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695deb-90d7-4f9d-a13d-3c4113a63399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.767676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c877ad-e692-4154-9761-d9a26ece3711 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:27.778811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:27.779506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.779835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.780180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.781374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:27.781864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:27.788253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986566-9bfc-43c9-ba04-0b3e16cb458c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:27.788397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8e695deb-90d7-4f9d-a13d-3c4113a63399 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.788397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8e695deb-90d7-4f9d-a13d-3c4113a63399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.801047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 779/1542] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:27.812178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.813107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.813396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.827290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 764/1543] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:27.828925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea29e-a138-4a98-9f94-bb0bcfdd223a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.829252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea29e-a138-4a98-9f94-bb0bcfdd223a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.829543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea29e-a138-4a98-9f94-bb0bcfdd223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.843974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.845758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.865492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 780/1544] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:27.866100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:27.876771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0aeea29e-a138-4a98-9f94-bb0bcfdd223a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.878028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0aeea29e-a138-4a98-9f94-bb0bcfdd223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.886212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec63750-20dc-4cf2-b2f8-a0b1da60ab81 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:27.907202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 765/1545] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:27.916813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.917162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.917367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.919336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:27.920014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.920295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.920574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.921273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:27.923278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19224ea2-0f1f-4d7e-aca9-3464176a8c86 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:27.962520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.965311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.986980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 766/1546] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:27.988059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:27.999584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880445-5d5c-4b0f-ae2e-839cc917163f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.009506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.010410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.010914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.011471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.013320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.014146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.018402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c40b2-4563-4e64-91db-f5b77ce6bcce admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.042464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 767/1547] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.044862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7bef-ef62-46e4-9af8-5f429991c045 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.045369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7bef-ef62-46e4-9af8-5f429991c045 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.045771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e7bef-ef62-46e4-9af8-5f429991c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.063208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 781/1548] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.064701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bae1b-8207-41b3-bc23-f44ae1ec43a2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.064962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bae1b-8207-41b3-bc23-f44ae1ec43a2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.065252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bae1b-8207-41b3-bc23-f44ae1ec43a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.069794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7d5e7bef-ef62-46e4-9af8-5f429991c045 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.071182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7d5e7bef-ef62-46e4-9af8-5f429991c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.085314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4b1bae1b-8207-41b3-bc23-f44ae1ec43a2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.086600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4b1bae1b-8207-41b3-bc23-f44ae1ec43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.135302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 768/1549] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.136517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5098-71ad-400e-87c4-bb09bc106537 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.136765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5098-71ad-400e-87c4-bb09bc106537 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.137051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5098-71ad-400e-87c4-bb09bc106537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.155765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 782/1550] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.157178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf386-d1ad-4ada-b558-0c50dee17315 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.157557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf386-d1ad-4ada-b558-0c50dee17315 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.157775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf386-d1ad-4ada-b558-0c50dee17315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.158567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-92ee5098-71ad-400e-87c4-bb09bc106537 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.159891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-92ee5098-71ad-400e-87c4-bb09bc106537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.172813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 769/1551] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.175185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.178213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.178213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.182150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7b0cf386-d1ad-4ada-b558-0c50dee17315 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.183375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7b0cf386-d1ad-4ada-b558-0c50dee17315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.196723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 783/1552] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.196723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.196723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.196723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.198648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.200058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.209210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 770/1553] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.213923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.218802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.220663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.223560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcedd41-a350-49cd-9c4a-a06a6c3379d5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.228463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.229063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.229604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.229763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 784/1554] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.229865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.230243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.230367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.231435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:28.231435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:15:28.231435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:15:28.232622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.250632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dc3a1-1b8a-40d4-b626-b9cff0035e42 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.256774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.258115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.258115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.258115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.258819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.259875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:28.259875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:15:28.259875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:15:28.261106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efa0a-6a95-47ca-abea-91d63254b762 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.326767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 771/1555] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.327496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.331471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 785/1556] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.333423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d1e9-0e76-4799-93fd-39c34116d7d8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.333888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d1e9-0e76-4799-93fd-39c34116d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.334168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d1e9-0e76-4799-93fd-39c34116d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.354656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6cf4d1e9-0e76-4799-93fd-39c34116d7d8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.355898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6cf4d1e9-0e76-4799-93fd-39c34116d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.403453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841445e-9808-475f-b608-68c50bb3eb6a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.408393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.408988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.409482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.409839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.410564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.410900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.412528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.425107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 772/1557] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.426052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.431036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 786/1558] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.434467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888369a4-539a-4b48-b369-e1fd4f0cffac None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.435013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888369a4-539a-4b48-b369-e1fd4f0cffac None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.435473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888369a4-539a-4b48-b369-e1fd4f0cffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.444087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3765-cfe0-461d-a0b9-42f967fad384 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.448966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.449670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.449951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.450225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.450943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.451242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.452836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e4ce0-44a5-4b30-a7e2-1b1f8a3d3806 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.456917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-888369a4-539a-4b48-b369-e1fd4f0cffac None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.458493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-888369a4-539a-4b48-b369-e1fd4f0cffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.463805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:28.467311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 787/1559] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.473869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 773/1560] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.474013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.474110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.474200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.474277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.474421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.474518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.488244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.490278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.491799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:28.493008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:28.502582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 774/1561] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.503400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.508531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 788/1562] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:28.509385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.514988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce4972-8e9f-442c-a8bd-0883876834d4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.519502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459274e6-ba00-402a-a958-35bd8a6b8034 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.519829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.520591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.520894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.521177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.521934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.523900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.524813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.525497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.525850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.526197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.527035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.528763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.530683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:28.540357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 789/1563] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:28.548025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.552359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed53445-e598-452b-abd0-67e5842b4fd3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.557530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.558242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.558530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.558817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.559504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.561402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.616796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 775/1564] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.617815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.627609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2de5e1-6110-465a-af5c-58ff8145d2ad admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.633088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.633777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.634063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.634343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.635059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.635364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.636996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.649321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 790/1565] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.649321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.653535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 776/1566] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.654641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.668926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5701-fc19-4ab2-84f7-3d87a86a9da2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.724467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1a55-9e50-4bf6-b973-7025656e3fb7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.727503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.728177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.728459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.728738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.729243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.729456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.729794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.729946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.730234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.730518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.731212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.731402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.733126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.751496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 777/1567] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.751496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.757516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d8484-0627-40d4-a56a-7cd57eb99a3e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.761748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.762429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.762736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.763037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.763786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.764118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.765842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.780898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 778/1568] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.781776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.792454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92998afb-2187-4fa5-83e5-e373a740274e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.797313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.798229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.798397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.798579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.799251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:28.799553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.801253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.815863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 779/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:28.816729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.827072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827623-190c-48df-a052-8f7da723ee67 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.832661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.832866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.833094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.833409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.834148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.835759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.847010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 780/1570] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:28.851693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.859928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 791/1571] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.859928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.860179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913acfb-1a6d-47cc-b177-7dd9f7f1b39e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.922466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.922965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.923250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.923523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.924112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27038-c5f8-44a0-968d-625271ddd6fe admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.924354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.926030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.929692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.930367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.930656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.930939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.931632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.933559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.937238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 781/1572] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:28.938393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.950155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407ee90-7616-43f0-8884-c817730cac77 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.955094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.955753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.956038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.956314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.957002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.961628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.977806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.023384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 792/1573] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.024069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.033842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e7a3c-b621-4221-b676-2bc896b8b2ae admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.038757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.039400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.039684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.039968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.041198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.043378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.109449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 782/1574] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.110243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.138536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 793/1575] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.139302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.177858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.184532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478fefb-9ecc-4d7d-8398-1b8da4ee2e17 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.220284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1200c-b0af-49ba-88d8-4fa65eaeaa88 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.227536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.228336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.228683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.229023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.229930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.232471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.256957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.257910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.258340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.258627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.259322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.261260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.320489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 794/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.321392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.378608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 783/1577] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.379722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.391490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef3d70-78b1-4993-b8c9-399f81dfd264 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.451608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8e7df-b9f0-4d19-88c7-8b73432b0e6b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.455487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.456498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.456666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.456778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.457015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] PATH_INFO: `/v3/projects/9fc4170d9d79448b81de3b7638c1a3a7/users/8b273bb179aa4dc987fd7f67c7131724/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.457229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.457514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.457821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.458521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.460465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.486162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc4170d9d79448b81de3b7638c1a3a7, user_id=8b273bb179aa4dc987fd7f67c7131724, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.489763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.559915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 784/1578] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.560803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.571435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31233-b55f-466a-a36f-dc56a246f55c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.576157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.576822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.577105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.577386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.578132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.579981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.588298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 795/1579] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:29 2022] PUT /identity/v3/projects/9fc4170d9d79448b81de3b7638c1a3a7/users/8b273bb179aa4dc987fd7f67c7131724/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:29.597533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.597714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 785/1580] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:29.597714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.603181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.607177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756ffd7-238d-4fe8-affb-df35f343af1f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.637470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.655209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386a4a4-5594-4b4d-a376-420dfda81fbd admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.660450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.662074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.667616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.667616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.667616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.667616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.672506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.673248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.673527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.673829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.674521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.675984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 796/1581] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:29.676467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.677136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.692875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4ad0-6419-4ce8-bf01-ac0f69d2de39 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.700891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.701818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.702053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.702345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.703074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.705277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.772234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 786/1582] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.773253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.783719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da62e-81a8-41d7-9e9b-de0973d730bd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.789538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.790259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.790655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.790923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.791631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.793703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.805691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 797/1583] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.806749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.818162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f30-9572-40c5-8dca-470e578339ec admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.823034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.823706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.827396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.827396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.827396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.827396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.880116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 787/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.881250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.891133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46380-8bc9-412f-ad52-5c744e8e4af3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.896315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.897042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.897323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.897627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.898340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.900020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7c644-8c77-4580-b419-778c242e22b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.909678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 798/1585] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:29.909678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.916730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 788/1586] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:29.916730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.916730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.916730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.921360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea8ae-0503-4156-b95c-c6bd3ee5f804 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.926324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.927424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.927748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.928048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] PATH_INFO: `/v3/projects/74d319f13b1849f99f34d7f313f375be/users/95a0d5d3971a41c1ab6f65b953661393/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.933158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:29.934425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:29.946816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 789/1587] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:29.955034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d319f13b1849f99f34d7f313f375be, user_id=95a0d5d3971a41c1ab6f65b953661393, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.955727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.955851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.957002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1e21-32e3-4225-a012-2f9166f2dbb0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:29.962793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:29.963455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.963737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.964007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.964716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:29.966357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:29.977128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 790/1588] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:29.978093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:29.987740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b8fb1-e5ee-466c-956e-b1a7cf72a7bc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.006616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.006616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.006616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.006616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.007058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.007058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.007674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 791/1589] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.008664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.019001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0de0e2-98a0-41a8-b850-e7fcf8f77455 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.025075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.025787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.026072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.026359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.027080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.028697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.039790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 792/1590] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.042892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.050954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b10a4-161a-4f7a-8251-850950acc9a2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.056932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.060154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.060154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.060154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.060154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.060529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.062404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 799/1591] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:29 2022] PUT /identity/v3/projects/74d319f13b1849f99f34d7f313f375be/users/95a0d5d3971a41c1ab6f65b953661393/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.068144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.073020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 793/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.074010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.086555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c05c-5918-4ce9-ba01-d161c9daa682 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.142129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecab9c-c3f0-4a36-866b-8509eaa168ad admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.147860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.148548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.148839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.149118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.149887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.151521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.156841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.158165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.158450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.158727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.159628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.162315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.162471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 800/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.163188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.180645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 794/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.180645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.189772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6c2d-816a-451d-b964-8c895f32f21e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.195542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.196376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.196733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.197012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] PATH_INFO: `/v3/projects/c1e6e20ff4b44ca0abab9e8065d53b1f/users/cb30fcf6e0494463a3172bb37e38ab85/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.209015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:30.219232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e6e20ff4b44ca0abab9e8065d53b1f, user_id=cb30fcf6e0494463a3172bb37e38ab85, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.220888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:30.220888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:15:30.220888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:15:30.222552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57719ff1-641f-451e-be3c-f5eae76287cf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.230368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f821-1459-4cef-8108-37b770ee4eba admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.234584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.235334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.235718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.236097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.246468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.247923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.258960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 801/1595] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:30.259928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.270027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecbee-8112-45b0-b9a4-ece3b137c5a8 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.275832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.276572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.276923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.277224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.278002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.279640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.291670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 802/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.292732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.303979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bece3e-b92c-4f97-ac62-076c6f2c3dd2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.309562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.310290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.310601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.310881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.311652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.313335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.314934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:30.319118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 795/1597] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/c1e6e20ff4b44ca0abab9e8065d53b1f/users/cb30fcf6e0494463a3172bb37e38ab85/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.324001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.324523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.325139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.332117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 803/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.332117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.339220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c468-7fb0-4434-9574-f96c1f597063 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.345801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:30.347101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:30.425329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.427069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 796/1599] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:30.427927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.429757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.430934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.431508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.433439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.436592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.438957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe247c2-40c6-4da1-a384-e5d95b0d7696 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.444954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.447318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.447657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.448009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] PATH_INFO: `/v3/projects/ec0ecebd089a4e479f6909fed9101d0e/users/aed9843697634f8792ac0ec21a16288e/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.454034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 804/1600] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.455944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.467115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0ecebd089a4e479f6909fed9101d0e, user_id=aed9843697634f8792ac0ec21a16288e, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.469743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38caf85-bc1d-463e-a9dc-0afbb878284f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.471529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2914-5ef0-4813-987a-a7400b5ca1a9 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.477205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.484128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.484128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.484128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.484128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.484128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.492741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 805/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:30.493545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.503695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541b09f-dc5f-4f4d-a665-8ef0b938895e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.509085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.513628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.513628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.513628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] PATH_INFO: `/v3/projects/d2129c74d9eb4704ae84a53173ea4443/users/658611df52f34f87a074a3467a42d4f5/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.526098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2129c74d9eb4704ae84a53173ea4443, user_id=658611df52f34f87a074a3467a42d4f5, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.528768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.587810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 797/1602] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/ec0ecebd089a4e479f6909fed9101d0e/users/aed9843697634f8792ac0ec21a16288e/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.587810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.587810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.587810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.613731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 806/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/d2129c74d9eb4704ae84a53173ea4443/users/658611df52f34f87a074a3467a42d4f5/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.615406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.630623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:30.633068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:30.688598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8dd8-7d42-4dc9-84f2-71e3143afbe2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.694629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.695718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.695993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.696280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] PATH_INFO: `/v3/projects/f1db9f8481d84018b673ea36187319d1/users/0c1f819fd226423ea4d0f95f606f1411/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.711879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 798/1604] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:30.713033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.714740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:30.719484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1db9f8481d84018b673ea36187319d1, user_id=0c1f819fd226423ea4d0f95f606f1411, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.722470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.781478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778e71f-cfaa-44e5-954c-2431ee4370ea None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.785558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.787054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.787215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.787493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.800787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.804633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.814067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 799/1605] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:30.814952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.825385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8112b1-176f-4637-bbf1-23f061e33a2e service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.835201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.839117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.839117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.839117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] PATH_INFO: `/v3/projects/d7aca29d2e78488ca4bbaac6d49558e1/users/30dbcf8c4040452c8bce1c9b27cf801a/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.839759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:30.855923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aca29d2e78488ca4bbaac6d49558e1, user_id=30dbcf8c4040452c8bce1c9b27cf801a, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.859109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21357f-d45a-4fae-93ec-a866a105c7ee admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.872036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 807/1606] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/f1db9f8481d84018b673ea36187319d1/users/0c1f819fd226423ea4d0f95f606f1411/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.873525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:30.927784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:30.949216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2124bf-a0f2-49e9-ae76-71682935c19a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:30.954228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:30.955130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.955404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.955678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] PATH_INFO: `/v3/projects/240c382c2d2f431c91d250fa0446ec80/users/a1c227a7009144309cf2c12e3b94142b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.975787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=240c382c2d2f431c91d250fa0446ec80, user_id=a1c227a7009144309cf2c12e3b94142b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:30.977778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 800/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/d7aca29d2e78488ca4bbaac6d49558e1/users/30dbcf8c4040452c8bce1c9b27cf801a/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:30.979153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d507a7-89e7-46ee-ac5a-a426792673b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:30.979505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d507a7-89e7-46ee-ac5a-a426792673b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:30.979879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d507a7-89e7-46ee-ac5a-a426792673b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:30.982714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:30.999366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-37d507a7-89e7-46ee-ac5a-a426792673b3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.000680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-37d507a7-89e7-46ee-ac5a-a426792673b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.070009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 801/1608] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.071250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f6b-596a-4520-88bd-35731e180fd6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.071522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f6b-596a-4520-88bd-35731e180fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.071800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114f6b-596a-4520-88bd-35731e180fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.091888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 808/1609] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:30 2022] PUT /identity/v3/projects/240c382c2d2f431c91d250fa0446ec80/users/a1c227a7009144309cf2c12e3b94142b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:31.096595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:31.096741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4f114f6b-596a-4520-88bd-35731e180fd6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.096741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4f114f6b-596a-4520-88bd-35731e180fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.165674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007150-2ac0-4f08-9361-493712eaa0ff admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:31.171664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:31.172974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.173736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.174207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.181353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 802/1610] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.182730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.183029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.183318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.198736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:31.200672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e1be4-d533-4ee0-a441-79420825ccc3 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:31.213883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] MFA Rules not processed for user `0c1f819fd226423ea4d0f95f606f1411`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.215154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.228428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 809/1611] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:31.228428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.228428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.228428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.271156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] MFA Rules not processed for user `30dbcf8c4040452c8bce1c9b27cf801a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.273212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.322045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 803/1612] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.324394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:31.342373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528e228-61d7-44de-9cd4-825b44026db7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:31.350012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:31.351288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.351777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.352237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.373544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:31.373544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9fc02-3924-4d2e-b0e2-a6821d8f519c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:31.386660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:31.396294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 804/1613] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:31.398751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3126f-1af2-41c1-b96a-dfc31a83b435 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.399247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3126f-1af2-41c1-b96a-dfc31a83b435 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.399835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3126f-1af2-41c1-b96a-dfc31a83b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.454339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 810/1614] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.454339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:31.463038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c4f3126f-1af2-41c1-b96a-dfc31a83b435 None None] MFA Rules not processed for user `a1c227a7009144309cf2c12e3b94142b`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.466070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c4f3126f-1af2-41c1-b96a-dfc31a83b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.490858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a696-5ac2-4093-bb86-3afc20a58b3b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:31.502616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:31.511316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.511316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.511316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.516742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:31.518702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:31.531552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 811/1615] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:31.554418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:31.571044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 805/1616] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.574281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554006-020e-45bb-9e88-c53b55bed06a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.574706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554006-020e-45bb-9e88-c53b55bed06a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.575062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554006-020e-45bb-9e88-c53b55bed06a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.582354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ebe3-c936-477a-8b12-88c1ecd44746 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:31.589004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:31.589918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 806/1617] 10.222.0.60 () {54 vars in 961 bytes} [Mon Jul 11 14:15:31 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:31.590058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.590323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.590688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.591697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:31.594874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4c0aa-531d-43f5-a16c-982182746b03 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:31.599119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc298-7ee7-4bdd-811d-f6ec32afe897 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.599337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc298-7ee7-4bdd-811d-f6ec32afe897 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.599598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc298-7ee7-4bdd-811d-f6ec32afe897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.671081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-18ccc298-7ee7-4bdd-811d-f6ec32afe897 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.674346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18ccc298-7ee7-4bdd-811d-f6ec32afe897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.711746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 812/1618] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:31.716993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490968-1eaa-444f-8e95-1b248c28319a None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.717516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490968-1eaa-444f-8e95-1b248c28319a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.717805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21490968-1eaa-444f-8e95-1b248c28319a None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.719793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 813/1619] 10.222.0.60 () {54 vars in 961 bytes} [Mon Jul 11 14:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:31.720925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21490968-1eaa-444f-8e95-1b248c28319a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:31.756160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:31.826952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 807/1620] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:31.828454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.828749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.830018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.832576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21490968-1eaa-444f-8e95-1b248c28319a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:31.839007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:31.839800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:31.840149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:31.840491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:31.841279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:31.843417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:31.863165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:31.864526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:31.937180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 814/1621] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/users => generated 308 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:31.941482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.002246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 808/1622] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Jul 11 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:32.003853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.017616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:32.029412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43fec-2821-4de7-9dea-f93b1397cd50 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.040024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.040884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.041487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.042066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.043520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.046180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.077504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 809/1623] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:32.079184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.081464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00136dc5-aba4-41dd-9c34-b37fb570d2a5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.097092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.102752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.102911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc0bd-4d83-4a40-83e7-99acd9430456 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.103029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.103029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.109800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.110990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.111586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.112200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.220411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.222070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.237101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.238860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.263022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 810/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:32.263967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.274585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 815/1625] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:32.282516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3794c2c-a33b-4d26-aa73-207e4b94df08 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.302230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.302230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.302230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.302230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] PATH_INFO: `/v3/projects/a8b951ce32c74f46beaf90e10625dc2e/users/c64bc5d6d2894518b6f33ecf7d133c79/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.311824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b951ce32c74f46beaf90e10625dc2e, user_id=c64bc5d6d2894518b6f33ecf7d133c79, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.315420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4246ec-3038-4958-bb70-957104e93ca5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.443817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 811/1626] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:32 2022] PUT /identity/v3/projects/a8b951ce32c74f46beaf90e10625dc2e/users/c64bc5d6d2894518b6f33ecf7d133c79/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:32.444824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.461001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d879d-a47c-45df-a732-5a6ce8eabf8f service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.539511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177870b-d551-4a10-a803-1280fbebff0b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.539992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177870b-d551-4a10-a803-1280fbebff0b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.540735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177870b-d551-4a10-a803-1280fbebff0b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.542902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 812/1627] 10.222.0.60 () {54 vars in 912 bytes} [Mon Jul 11 14:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:32.550717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.551053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.551336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.552992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.554029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.554524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.554977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.555872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.558546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.571007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 816/1628] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:32.574749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.576282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:32.578597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:32.588135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a21fd-7beb-4bd5-be84-ceb466d52c93 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.596027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.597928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.599058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.603049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] PATH_INFO: `/v3/projects/a8b951ce32c74f46beaf90e10625dc2e/users/c64bc5d6d2894518b6f33ecf7d133c79/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.604055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b951ce32c74f46beaf90e10625dc2e, user_id=c64bc5d6d2894518b6f33ecf7d133c79, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:32.607587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88553f-6008-4d8d-9824-e50fd78022c2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:32.625237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 817/1629] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:32 2022] PUT /identity/v3/projects/a8b951ce32c74f46beaf90e10625dc2e/users/c64bc5d6d2894518b6f33ecf7d133c79/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:32.637839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.640068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.640588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.701342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] MFA Rules not processed for user `c64bc5d6d2894518b6f33ecf7d133c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:32.703830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:32.735341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 813/1630] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:32.752663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.837663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 818/1631] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:32.851521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:32.882168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e85e66-273a-4d83-a2c5-89054c8120af None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.895965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:32.940613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:32.951661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b97dc9-0c71-435a-9252-6200b1d8527e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:32.965594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.966715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.969779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.969779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.972587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:32.974230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:32.974882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:32.975422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:32.994956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:33.000356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d354ff-474d-4782-873b-f97ff73e0758 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:33.023097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 819/1632] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:33.038903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50505c-6958-4184-9121-55ba490b9c51 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:33.040618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50505c-6958-4184-9121-55ba490b9c51 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:33.041247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50505c-6958-4184-9121-55ba490b9c51 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:33.046688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 820/1633] 10.222.0.60 () {54 vars in 912 bytes} [Mon Jul 11 14:15:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:33.056659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:33.057426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:33.058108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:33.080480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:33.081647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:33.097598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 814/1634] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:33.099102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:33.103919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:33.136322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 821/1635] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:33.174870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:33.546230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1642f-b71b-44aa-89b8-8b4dd65cdbf5 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:33.546230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:33.546230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:33.546230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:33.549789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:33.549789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:33.549789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:33.549789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 815/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:33.631150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:33.677242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:33.730429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e98b8-c1a4-4ade-a630-a439048a310a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:33.738008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:33.739691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:33.740302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:33.741006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] PATH_INFO: `/v3/users/0c1f819fd226423ea4d0f95f606f1411` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:33.742964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1f819fd226423ea4d0f95f606f1411)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:33.745971 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:33.829852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1fc52-5e1b-4e10-9f73-4245e7d1f82e service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:33.835856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:33.836953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:33.837309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:33.837806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] PATH_INFO: `/v3/users/a1c227a7009144309cf2c12e3b94142b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:33.840339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c227a7009144309cf2c12e3b94142b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:33.841296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:33.841296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 11 14:15:33.841296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: Jul 11 14:15:33.842943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:34.000708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1f819fd226423ea4d0f95f606f1411'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.011372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1f819fd226423ea4d0f95f606f1411'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.012873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1f819fd226423ea4d0f95f606f1411'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.054253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1f819fd226423ea4d0f95f606f1411'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.125880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:34.253805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c14ab3f3-5e45-466b-b7ba-9ad3b870d8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1f819fd226423ea4d0f95f606f1411'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.267121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:34.273893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 822/1637] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:33 2022] DELETE /identity/v3/users/0c1f819fd226423ea4d0f95f606f1411 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:34.279273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.279986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.280519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.292555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c227a7009144309cf2c12e3b94142b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.295190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c227a7009144309cf2c12e3b94142b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.337233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c227a7009144309cf2c12e3b94142b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.342328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:34.342837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.387415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c227a7009144309cf2c12e3b94142b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.479701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 823/1638] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:34.483832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bca6acc9-9abd-4bc5-a4d8-dfe09a975967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c227a7009144309cf2c12e3b94142b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:34.505848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 816/1639] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:33 2022] DELETE /identity/v3/users/a1c227a7009144309cf2c12e3b94142b => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:34.507597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:34.510290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.511164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.512525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.513263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.584754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:34.592714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.731633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d36b3-5479-4cdd-b1f3-52be158f1b2b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:34.802437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 817/1640] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:34.830911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:34.832637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.836997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.836997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.837168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:34.837757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.840001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.863569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ed12-2dd4-4a4a-a5f5-0d9c04d0ed98 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:34.874194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:34.874892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.875184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.875461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.884384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:34.886188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:34.894703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:34.897431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:34.921237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 824/1641] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:34.931666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 818/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:35.460766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:36.827374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:36.829004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:36.843805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31170-728e-42f0-a019-1713eafd98eb service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:36.856436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:36.857804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:36.858256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:36.858688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] PATH_INFO: `/v3/projects/240c382c2d2f431c91d250fa0446ec80` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:36.862557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=240c382c2d2f431c91d250fa0446ec80)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:36.864080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:36.864080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:15:36.864080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:15:36.870240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:36.871648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:36.871867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:36.899129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598095-8356-4630-80a9-3d04cd77fedc service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:36.919409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:36.920259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:36.920548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:36.920834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] PATH_INFO: `/v3/projects/f1db9f8481d84018b673ea36187319d1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:36.923333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1db9f8481d84018b673ea36187319d1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:36.930015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:37.121903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240c382c2d2f431c91d250fa0446ec80', 'request_id': 'req-95b9fa88-e768-4522-855c-f700944e44aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.148116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240c382c2d2f431c91d250fa0446ec80', 'request_id': 'req-95b9fa88-e768-4522-855c-f700944e44aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.181990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1db9f8481d84018b673ea36187319d1', 'request_id': 'req-cea259f9-fd48-4f21-88ef-b650abe41732'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.194038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1db9f8481d84018b673ea36187319d1', 'request_id': 'req-cea259f9-fd48-4f21-88ef-b650abe41732'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.275383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240c382c2d2f431c91d250fa0446ec80', 'request_id': 'req-95b9fa88-e768-4522-855c-f700944e44aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.312553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] The token cache is being invalidate because project 240c382c2d2f431c91d250fa0446ec80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:37.312887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.313599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95b9fa88-e768-4522-855c-f700944e44aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.316013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 825/1643] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:36 2022] DELETE /identity/v3/projects/240c382c2d2f431c91d250fa0446ec80 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:37.321425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877df13-d5e4-4f9b-9f17-bfb06194a693 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:37.321806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877df13-d5e4-4f9b-9f17-bfb06194a693 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:37.322166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877df13-d5e4-4f9b-9f17-bfb06194a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:37.345001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4877df13-d5e4-4f9b-9f17-bfb06194a693 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:37.346420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4877df13-d5e4-4f9b-9f17-bfb06194a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:37.388595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1db9f8481d84018b673ea36187319d1', 'request_id': 'req-cea259f9-fd48-4f21-88ef-b650abe41732'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.424011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] The token cache is being invalidate because project f1db9f8481d84018b673ea36187319d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:37.424298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.425465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.430624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 819/1644] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:36 2022] DELETE /identity/v3/projects/f1db9f8481d84018b673ea36187319d1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:37.434836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:37.436450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:37.510646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 826/1645] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:37.514693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:37.515048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:37.517107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:37.533989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:37.569719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:37.571675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:37.595695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 827/1646] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:37.599439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea259f9-fd48-4f21-88ef-b650abe41732 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:37.601553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:37.611274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:37.613111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8fad6-7cb0-49bf-9c96-ea3b4152f189 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:37.614339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:37.616106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:37.616596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] PATH_INFO: `/v3/users/c64bc5d6d2894518b6f33ecf7d133c79` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:37.618701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:37.619593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:37.619696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:37.619932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:37.621692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:37.622055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:37.623209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: WARNING py.warnings [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:15:37.623209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: warnings.warn(msg) Jul 11 14:15:37.623209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: Jul 11 14:15:37.623574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64bc5d6d2894518b6f33ecf7d133c79)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:37.624348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:37.629474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:37.647232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 828/1647] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:37.648433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:37.660552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5086eb-e55d-4006-9570-30e7247d8fc1 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:37.672198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:37.672894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:37.673232 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:37.674179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:37.676346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:37.679386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:37.824805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 829/1648] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:37 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:37.829321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:37.878972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:37.892495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64bc5d6d2894518b6f33ecf7d133c79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.893835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64bc5d6d2894518b6f33ecf7d133c79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.913096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64bc5d6d2894518b6f33ecf7d133c79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:37.959073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64bc5d6d2894518b6f33ecf7d133c79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:38.009490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6931-c8e9-4a39-9b9b-a325c66a0c51 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:38.017523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:38.019165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:38.019604 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:38.022695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:38.022695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:38.026870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:38.039325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64bc5d6d2894518b6f33ecf7d133c79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:38.049320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 820/1649] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:37 2022] DELETE /identity/v3/users/c64bc5d6d2894518b6f33ecf7d133c79 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:38.159563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 830/1650] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:37 2022] POST /identity/v3/users => generated 284 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:38.164147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:38.165867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:38.322249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df742-7645-4be1-935e-2a3b43258b65 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:38.333658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:38.333658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:38.333658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:38.337970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:38.337970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:38.340417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:38.362935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 821/1651] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:38.368397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:38.383719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21df1-17f8-4661-9b49-35674676b30c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:38.443731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:38.445429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:38.453891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:38.455187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:38.457054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:38.461327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab50e07-707b-4738-885c-f96fed7bcc62 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:38.550585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:38.561816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 831/1652] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:38.601540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818f4d-edff-4b4b-8b80-c665d6784acc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:38.643788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:38.646201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:38.648723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:38.649172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] PATH_INFO: `/v3/projects/88e31afc644f45608925739534624a3d/users/517984e9f5ae40e0ba81194fe2f83347/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:38.710920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e31afc644f45608925739534624a3d, user_id=517984e9f5ae40e0ba81194fe2f83347, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:38.722225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:38.858322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 822/1653] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:38 2022] PUT /identity/v3/projects/88e31afc644f45608925739534624a3d/users/517984e9f5ae40e0ba81194fe2f83347/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:38.870654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:38.871403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:38.871591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:38.943945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] MFA Rules not processed for user `517984e9f5ae40e0ba81194fe2f83347`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:38.951961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:39.098873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 832/1654] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:39.100842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:39.143522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:39.252691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027d32-274d-4893-9bc3-474345bf8f57 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:39.271744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:39.273025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:39.273622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:39.274178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:39.275141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:39.280299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:39.427957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:39.438697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 823/1655] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:39 2022] POST /identity/v3/projects => generated 369 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:39.446953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614fd4e-1345-46c0-aefd-186c30320c78 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:39.649054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:39.649791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:39.650079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:39.650359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:39.651067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:39.653200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:40.476283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 833/1656] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:39 2022] POST /identity/v3/users => generated 291 bytes in 1051 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:40.480796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.528037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c59c-0794-449e-80b4-eca481c006a3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:40.534710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:40.539717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:40.540528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:40.541019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:40.542416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:40.544371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:40.570452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 824/1657] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:40.574273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.593268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd5941-2013-4cf4-bee0-c845477fa057 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:40.612947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:40.619531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:40.621013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:40.622403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] PATH_INFO: `/v3/projects/d02e1ee6670d4104bd3d079c86bbf056/users/40e77f633c364f869277416525fc9fc0/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:40.633161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:40.709113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02e1ee6670d4104bd3d079c86bbf056, user_id=40e77f633c364f869277416525fc9fc0, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:40.735813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:40.828634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.842400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:40.854959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 834/1658] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:40 2022] PUT /identity/v3/projects/d02e1ee6670d4104bd3d079c86bbf056/users/40e77f633c364f869277416525fc9fc0/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:40.863354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.873474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ad1d5-b04e-4f14-bdfc-633ca400fccb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.030264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d228aa-fd8e-4be7-bdf4-5da28d065c98 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.037758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.038628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.038916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.039443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.040690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.045178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.070369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 835/1659] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:41.087127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.087654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.089259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.092823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.094286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] PATH_INFO: `/v3/projects/a8b951ce32c74f46beaf90e10625dc2e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.105392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b951ce32c74f46beaf90e10625dc2e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.110471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.145118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e34b2-4a45-4315-a473-b78a76631435 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.175435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.179589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.182873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.183789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] PATH_INFO: `/v3/projects/d02e1ee6670d4104bd3d079c86bbf056/users/40e77f633c364f869277416525fc9fc0/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.196288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02e1ee6670d4104bd3d079c86bbf056, user_id=40e77f633c364f869277416525fc9fc0, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.203170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d28f8-06ac-4c71-9201-aeb0d8a92f9b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.254540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 836/1660] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:41 2022] PUT /identity/v3/projects/d02e1ee6670d4104bd3d079c86bbf056/users/40e77f633c364f869277416525fc9fc0/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:41.267522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.267887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.268286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.363806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] MFA Rules not processed for user `40e77f633c364f869277416525fc9fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:41.369357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.416085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b951ce32c74f46beaf90e10625dc2e', 'request_id': 'req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.433195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b951ce32c74f46beaf90e10625dc2e', 'request_id': 'req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.562509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b951ce32c74f46beaf90e10625dc2e', 'request_id': 'req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.591161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] The token cache is being invalidate because project a8b951ce32c74f46beaf90e10625dc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:41.591161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.594300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78ed6398-fdd0-4cce-9c33-8203eff3bcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.601326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 825/1661] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:40 2022] DELETE /identity/v3/projects/a8b951ce32c74f46beaf90e10625dc2e => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:41.607757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaa7a-4eb0-4dbf-9c8e-51560e5883cf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.615366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaa7a-4eb0-4dbf-9c8e-51560e5883cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.615739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaa7a-4eb0-4dbf-9c8e-51560e5883cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.677996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c4efaa7a-4eb0-4dbf-9c8e-51560e5883cf None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:41.681090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c4efaa7a-4eb0-4dbf-9c8e-51560e5883cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.693360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 837/1662] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:41.721402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.723339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.863728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:41.881008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 826/1663] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:41.893763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.893763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.893763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.895885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd499-da89-44fa-b90f-55138dbfd819 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.928556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.929751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.930227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.930669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.953016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:41.954581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.959996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:41.969413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.971215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.982681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:41.988643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.002936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3bc3-201c-4256-8d77-fed3aed54167 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.003189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 838/1665] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:42.017756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.018686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.019146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.019579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.022773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:42.023181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.028271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.064080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 828/1666] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:42.076761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.102424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac0c-09bb-4631-87f6-5f072dab94a5 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.120174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.120914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.121212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.121661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.128178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.128596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.167926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.170034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.202529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedc01e-a7a1-41d1-8660-e056c2da471c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.234502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.235858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.236301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.236650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] PATH_INFO: `/v3/users/30dbcf8c4040452c8bce1c9b27cf801a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.241791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dbcf8c4040452c8bce1c9b27cf801a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.254342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.310855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 839/1667] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:42 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:42.312463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.485168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11456-a67b-443d-8446-68f46a63dd9a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.494400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.495169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.495645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.495943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.496667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.499410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.583879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dbcf8c4040452c8bce1c9b27cf801a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.588115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dbcf8c4040452c8bce1c9b27cf801a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.619307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dbcf8c4040452c8bce1c9b27cf801a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.682037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dbcf8c4040452c8bce1c9b27cf801a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.682274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 840/1668] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:42 2022] POST /identity/v3/users => generated 302 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:42.683174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.707213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f044fa-2063-4d5e-827c-a382d9198b7b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.727939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.735169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.735169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.735169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.735169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.735169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.760580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbe124e2-668f-4771-9afe-20564ecc17ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dbcf8c4040452c8bce1c9b27cf801a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.779210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 829/1670] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:42 2022] DELETE /identity/v3/users/30dbcf8c4040452c8bce1c9b27cf801a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:42.779420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 841/1670] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:42.784489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.785509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.786565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.787199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.788888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.829684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8caa-9235-4f15-a153-c07f262bbfe7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.852811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:42.854359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.972901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.975352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.975352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.975352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.975352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.984731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.025722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 842/1671] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:43.029488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.070377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 830/1672] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:43.111399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40bc6-1ac5-481f-bcc6-37b25d15b659 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.126410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.127512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.127773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.128106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] PATH_INFO: `/v3/projects/53f6576b3d824b83af66b9ff6ca8ce01/users/97fc067a39d441df9d181e5840464648/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.166323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f6576b3d824b83af66b9ff6ca8ce01, user_id=97fc067a39d441df9d181e5840464648, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.169414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dd977-1168-4877-b7a6-7f09791d291b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.174059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.175765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.232383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:43.325321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 843/1673] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:43 2022] PUT /identity/v3/projects/53f6576b3d824b83af66b9ff6ca8ce01/users/97fc067a39d441df9d181e5840464648/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:43.328325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.328622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.333677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.338977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94e751-fc68-4e2a-885f-0eeb5d5c170a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.388523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:43.390797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.482401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:43.538543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.539430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.539695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.544345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.605736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 844/1674] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:43.696938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.699001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.738904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91847a91-f2d1-42a2-90a4-59bac82ec694 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.759996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.761230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.761873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.762906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.764117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.765532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59b90-c9e8-4fea-89ea-68f8080f3496 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.795705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 831/1675] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:43.798756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.808698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.839412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 845/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:44.711046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.711337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.711616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.786556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] MFA Rules not processed for user `8b273bb179aa4dc987fd7f67c7131724`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:44.790871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:45.015460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 832/1677] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:45.030786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:45.034585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:45.229511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757989-5d46-477f-87a3-97cf48857280 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:45.249794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:45.250492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:45.250946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:45.251361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:45.264166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:45.266476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340948b-8417-403c-9e32-e8386d2d2c6c service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:45.326412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 846/1678] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:47.139643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:47.143001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:47.182533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223bd0a-9c9e-4c15-89ce-f87c66e7727f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:47.204263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:47.204263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:47.204263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:47.205016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] PATH_INFO: `/v3/projects/d7aca29d2e78488ca4bbaac6d49558e1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:47.214962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7aca29d2e78488ca4bbaac6d49558e1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:47.228136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:47.251945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:47.437729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7aca29d2e78488ca4bbaac6d49558e1', 'request_id': 'req-828a408e-fa0f-4c0f-b534-e4962db593f6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:47.450815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7aca29d2e78488ca4bbaac6d49558e1', 'request_id': 'req-828a408e-fa0f-4c0f-b534-e4962db593f6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:47.583655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7aca29d2e78488ca4bbaac6d49558e1', 'request_id': 'req-828a408e-fa0f-4c0f-b534-e4962db593f6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:47.629616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] The token cache is being invalidate because project d7aca29d2e78488ca4bbaac6d49558e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:47.631032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:47.632166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-828a408e-fa0f-4c0f-b534-e4962db593f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:47.655202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 833/1679] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:47 2022] DELETE /identity/v3/projects/d7aca29d2e78488ca4bbaac6d49558e1 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:47.661142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:47.662683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:47.663166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:47.709994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:47.716759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:47.984473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 847/1680] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:47.993425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:47.993851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:47.994141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.012312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:48.014276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:48.041807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:48.050252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:48.050928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0608bc4-a699-4b34-8b45-72a19bdd3dca None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:48.065826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:48.068150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.069979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.070529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] PATH_INFO: `/v3/users/517984e9f5ae40e0ba81194fe2f83347` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.074545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517984e9f5ae40e0ba81194fe2f83347)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:48.079377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:48.086937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 834/1681] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:48.091452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:48.124251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d026c8-e2de-4eab-af55-f6b2cd0e46f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:48.136590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:48.143330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.144944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.146539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.148884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:48.150005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:48.154291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:48.188021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 835/1682] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:48.195622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:48.240643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7761e3-09d5-4980-a120-34f630b31f9b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:48.279394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:48.285015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.285015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.285015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.285015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:48.295936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:48.375579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:48.408250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517984e9f5ae40e0ba81194fe2f83347'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:48.435022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517984e9f5ae40e0ba81194fe2f83347'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:48.436154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517984e9f5ae40e0ba81194fe2f83347'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:48.457041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 836/1683] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:48 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:48.461095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:48.475904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517984e9f5ae40e0ba81194fe2f83347'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:48.582676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c198904d-4d3a-46e1-b4fe-2708ff9eb999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517984e9f5ae40e0ba81194fe2f83347'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:48.592412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 848/1684] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:48 2022] DELETE /identity/v3/users/517984e9f5ae40e0ba81194fe2f83347 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:48.596855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2a3ac-05c6-4ec9-880b-c4dd5e8c2c72 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.597228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2a3ac-05c6-4ec9-880b-c4dd5e8c2c72 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.597600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2a3ac-05c6-4ec9-880b-c4dd5e8c2c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.656696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0cb2a3ac-05c6-4ec9-880b-c4dd5e8c2c72 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:48.659294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0cb2a3ac-05c6-4ec9-880b-c4dd5e8c2c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:48.677215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2850b34-7230-421a-a8bc-a2c1652d099a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:48.836462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 849/1685] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:48.842004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:48.842004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.842004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.842004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.842569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:48.844826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:48.845522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:48.859664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:48.860466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:48.873636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:48.922817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] MFA Rules not processed for user `97fc067a39d441df9d181e5840464648`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:48.924411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:48.998330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 837/1686] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:48 2022] POST /identity/v3/users => generated 282 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:48.999254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.002980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:49.061615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 850/1687] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:49.067460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.075186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:49.123869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be696034-f787-4a40-b19e-8e450fee40e3 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.138299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.139129 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.139295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.139560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.140546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.142366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.147535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65320bf-fad7-4e9e-b0c3-72ece3b68ffb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.159011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.159705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.159988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.160266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.178130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 851/1688] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:49.181391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.186276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:49.187828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.193113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.218025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbf540-ae93-46aa-a741-e2d84ad27fce admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.226362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 838/1689] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:49.227493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.228765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.229523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.229840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.230118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.230832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.233255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.256147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772136-1518-4d99-a2f5-8c915564a8b9 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.270622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.271341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.271688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.272185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.273954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.278651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.304455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 839/1690] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:49.309387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.365068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e57a8-28b9-47bb-b609-a82f381e6881 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.377950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.384169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.388601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 852/1691] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:49 2022] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:49.394380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.394380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] PATH_INFO: `/v3/projects/dc1190399a164a4b8f4397a7fdb4d8a1/users/9017a0f4d3b244b387dcc25c9b1aefcd/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.394826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.439758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1190399a164a4b8f4397a7fdb4d8a1, user_id=9017a0f4d3b244b387dcc25c9b1aefcd, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.448289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fca5e-6aab-42a6-8889-19e044783628 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.475758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:49.601432 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 840/1692] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:49 2022] PUT /identity/v3/projects/dc1190399a164a4b8f4397a7fdb4d8a1/users/9017a0f4d3b244b387dcc25c9b1aefcd/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:49.609644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6da3c-b35f-4244-a326-29c829e575e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.611454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6da3c-b35f-4244-a326-29c829e575e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.612512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6da3c-b35f-4244-a326-29c829e575e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.635333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10152e-0bd3-4b9d-9bf1-579c04b11732 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:49.716199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9be6da3c-b35f-4244-a326-29c829e575e2 None None] MFA Rules not processed for user `9017a0f4d3b244b387dcc25c9b1aefcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:49.718781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9be6da3c-b35f-4244-a326-29c829e575e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:49.796801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:49.797774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.798295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.798728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.799632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:49.812679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:49.954435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 841/1693] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:49.957865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:49.959624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:49.960061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:49.965256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 853/1694] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:49 2022] POST /identity/v3/users => generated 308 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:49.969281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:49.990438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565352-8e68-4e76-b02d-89b046f10fbe admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.031140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.032220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.032686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.033124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.036211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.038556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.044778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] MFA Rules not processed for user `95a0d5d3971a41c1ab6f65b953661393`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:50.048415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:50.163949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:50.170454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 854/1695] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:49 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:50.171492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.275825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 842/1696] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:50.280217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.319322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1186e8-0ebd-44ad-a514-a220775aa048 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.396228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a690-161e-498d-89af-68ee5c21e73f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.401651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.402622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.403074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.403366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.404113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.405844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.443336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 855/1697] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:50.443336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.451917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:50.499770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.501348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.502013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.502940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.503719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.506044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.671148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 843/1698] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:50 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:50.671810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.691452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f075-339d-4aa5-8642-958a6abee2da admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.706173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe156-96f4-4abc-92d9-d4fea58431a8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.716119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.716820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.717155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.717440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.721704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.724295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.724586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.725643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] PATH_INFO: `/v3/projects/bdf446fa944f4499834abd142c9a0b77/users/dbcad65f419a48b5989e92db7750e0a9/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.737111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:50.775581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf446fa944f4499834abd142c9a0b77, user_id=dbcad65f419a48b5989e92db7750e0a9, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.782322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.862688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 844/1699] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:50 2022] PUT /identity/v3/projects/bdf446fa944f4499834abd142c9a0b77/users/dbcad65f419a48b5989e92db7750e0a9/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:50.879591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.962420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.968451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345c4fe-fb5b-4234-8f48-1039bd81bb43 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.995774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 856/1700] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:51.001425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.001677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.001962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.092616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] MFA Rules not processed for user `658611df52f34f87a074a3467a42d4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:51.095985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:51.102423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910257c2-9461-407f-8b35-9196dac7fe2b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.117900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.121118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.121352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.122631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.123767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:51.128308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:51.166858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 845/1701] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:51.167859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:51.199034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c5a7-7521-4686-ae9e-bbbcc61fbf40 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.217163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.217877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.218194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.218479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.221454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:51.226006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c0481-22be-4cf3-adb9-c75d9540ff30 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:51.262102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 846/1702] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:51.270271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.272455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.273281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.322591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 857/1703] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:51.324102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:51.351664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] MFA Rules not processed for user `cb30fcf6e0494463a3172bb37e38ab85`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:51.355565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7198e-8621-4a17-a047-6d8a500c54f8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.357147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:51.376401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.376401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.376401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.376401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] PATH_INFO: `/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead/users/eed8908ff5244d1f8ebbec31d1bfca93/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.389542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:51.416214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ddabb2fe5440f3a5c69dc3616c0ead, user_id=eed8908ff5244d1f8ebbec31d1bfca93, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:51.416214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0bd8-2c66-4259-9dde-43a7897bb3fe admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:51.492422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 847/1704] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:51.493219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:51.515929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71ce5-fd56-4ac7-9076-4c53428778b1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.527053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 858/1705] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:51 2022] PUT /identity/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead/users/eed8908ff5244d1f8ebbec31d1bfca93/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:51.527053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.527053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.527053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.565539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] MFA Rules not processed for user `658611df52f34f87a074a3467a42d4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:51.566847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:51.609056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:51.627120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.628394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.628886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.629318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] PATH_INFO: `/v3/projects/bdf446fa944f4499834abd142c9a0b77/users/dbcad65f419a48b5989e92db7750e0a9/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.633172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf446fa944f4499834abd142c9a0b77, user_id=dbcad65f419a48b5989e92db7750e0a9, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:51.638592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:51.657789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 848/1706] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:51 2022] PUT /identity/v3/projects/bdf446fa944f4499834abd142c9a0b77/users/dbcad65f419a48b5989e92db7750e0a9/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:51.660267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:51.664764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:51.699092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 859/1707] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:51.700707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:51.744188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef216d0-8889-4bb7-be39-8fdbb2996d0e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.831275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5b82a-5d26-4736-87b4-6e951c23a050 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:51.844668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.846886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.847389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.848066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.990433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:51.991844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:51.992453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:51.992949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:51.993929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:51.995831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.010150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.012455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.022563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 860/1708] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:52.029813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.032200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 849/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:52.034770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.039197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.060179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c7e-42df-4be7-b1a3-2b9c2c778c7d service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.069754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce110c6-ecea-46c1-aa95-4d37cdaded5c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.073459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.075498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.075980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.076317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] PATH_INFO: `/v3/projects/88e31afc644f45608925739534624a3d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.078059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e31afc644f45608925739534624a3d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.082606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.082860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.085882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.086506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.087012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.229360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.231207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.260296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 861/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:52.261409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.266662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e31afc644f45608925739534624a3d', 'request_id': 'req-d0770aee-2305-4611-b694-fe7e07229c00'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.271260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:52.288873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e31afc644f45608925739534624a3d', 'request_id': 'req-d0770aee-2305-4611-b694-fe7e07229c00'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.291306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333cc77-8a48-438f-8ed7-3109169193c0 service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.416563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e31afc644f45608925739534624a3d', 'request_id': 'req-d0770aee-2305-4611-b694-fe7e07229c00'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.439199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] The token cache is being invalidate because project 88e31afc644f45608925739534624a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:52.439689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.440614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0770aee-2305-4611-b694-fe7e07229c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.443395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 850/1711] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:52 2022] DELETE /identity/v3/projects/88e31afc644f45608925739534624a3d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:52.444789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9330-8c80-472c-af1c-f714ebf26838 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.445113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9330-8c80-472c-af1c-f714ebf26838 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.445965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9330-8c80-472c-af1c-f714ebf26838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.558456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.562826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a26f9330-8c80-472c-af1c-f714ebf26838 None None] MFA Rules not processed for user `aed9843697634f8792ac0ec21a16288e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:52.565932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.568302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a26f9330-8c80-472c-af1c-f714ebf26838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.569155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.576111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] PATH_INFO: `/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead/users/eed8908ff5244d1f8ebbec31d1bfca93/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.591751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ddabb2fe5440f3a5c69dc3616c0ead, user_id=eed8908ff5244d1f8ebbec31d1bfca93, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.608693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.654306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 862/1712] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:52 2022] PUT /identity/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead/users/eed8908ff5244d1f8ebbec31d1bfca93/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:52.656334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.668748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.693080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:52.782545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82f00-1338-4476-8f3d-d580ee633c5c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.789335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.790441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.790818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.791256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] PATH_INFO: `/v3/users/40e77f633c364f869277416525fc9fc0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.792907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e77f633c364f869277416525fc9fc0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.795093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.821108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 851/1713] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:52.838318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c52e-0f92-437e-a3b7-008999c08ef2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.838318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c52e-0f92-437e-a3b7-008999c08ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.838318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c52e-0f92-437e-a3b7-008999c08ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.863553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa09c52e-0f92-437e-a3b7-008999c08ef2 None None] MFA Rules not processed for user `eed8908ff5244d1f8ebbec31d1bfca93`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:52.865203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa09c52e-0f92-437e-a3b7-008999c08ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.956287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 852/1714] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:52.959161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.959161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.959833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.985516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] MFA Rules not processed for user `aed9843697634f8792ac0ec21a16288e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:52.986859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.098233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 853/1715] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:53.104444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:53.106215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.154994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e77f633c364f869277416525fc9fc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.189743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e77f633c364f869277416525fc9fc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.191165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e77f633c364f869277416525fc9fc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.220603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e77f633c364f869277416525fc9fc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.249953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8395b-cdfc-4a10-9b67-84aeb8b35c8e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:53.266996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:53.267749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.268012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.268359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.293636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:53.297801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:53.321780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 854/1716] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:53.322824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:53.327495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.388525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f5178f53-cf70-4c1e-a5b0-dfda1d069e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e77f633c364f869277416525fc9fc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.403550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 863/1717] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:52 2022] DELETE /identity/v3/users/40e77f633c364f869277416525fc9fc0 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:53.408267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1ff0-8ee5-453c-a8f3-2ff7678046cf None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.408839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1ff0-8ee5-453c-a8f3-2ff7678046cf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.412629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1ff0-8ee5-453c-a8f3-2ff7678046cf None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.416006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 864/1718] 10.222.0.60 () {54 vars in 912 bytes} [Mon Jul 11 14:15:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:53.424493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.424786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.425096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.577002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:53.586067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.633448 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932438-c430-4e26-b99a-075e4b6e8588 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:53.795120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 865/1719] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:53.796640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:53.797319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:53.797536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.797679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.797944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.799853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.804169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.816608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:53.914305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e3329-7648-4c56-8028-efb597ee552e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:53.919447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:53.920405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.921349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.921873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.925102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.960930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:53.962682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:53.970295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:53.983086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 855/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:53.984101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:53.998786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:54.031438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:54.032593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3bb-633e-4280-a0f1-7eb7f8315032 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:54.033281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35628-ba6c-4245-9444-55204449824e service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:54.050276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 866/1721] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:54.050978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:54.051769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:54.053205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:54.053518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:54.075323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:54.079669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff820e-adcf-483a-9da1-8b0ea7721f64 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:54.105057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 856/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:54.269028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:54.269510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:54.269510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:54.313467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] MFA Rules not processed for user `8b273bb179aa4dc987fd7f67c7131724`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:54.315441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:54.452473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 867/1723] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:55.004903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee8a-3336-495a-a160-66668df6acd5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:55.006344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee8a-3336-495a-a160-66668df6acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:55.006424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee8a-3336-495a-a160-66668df6acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:55.076112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3799ee8a-3336-495a-a160-66668df6acd5 None None] MFA Rules not processed for user `dbcad65f419a48b5989e92db7750e0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:55.077414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3799ee8a-3336-495a-a160-66668df6acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:55.247393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 857/1724] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:55.344826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:55.345326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:55.625643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ecd61-e1e0-49c0-a5e2-98edd4eea567 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:55.649667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:55.650563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:55.650882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:55.651164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] PATH_INFO: `/v3/projects/d02e1ee6670d4104bd3d079c86bbf056` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:55.652835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02e1ee6670d4104bd3d079c86bbf056)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:55.655102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:55.667531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51404-f083-47e6-80a8-2d1261f3480f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:55.667889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51404-f083-47e6-80a8-2d1261f3480f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:55.668172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51404-f083-47e6-80a8-2d1261f3480f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:55.669881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 858/1725] 10.222.0.60 () {54 vars in 912 bytes} [Mon Jul 11 14:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:15:55.679413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:55.690776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:55.690776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:55.733430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:55.735609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:55.769612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 859/1726] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:55.866251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:55.879647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b8015-d233-4055-b23e-bbfc6dd112a0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:55.897878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:55.898605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:55.902868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:55.902868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:55.922845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:55.924385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc412-79b8-47b7-9e60-fe944c7d1f6d service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:55.953650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 860/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:56.038730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02e1ee6670d4104bd3d079c86bbf056', 'request_id': 'req-bb041631-5e2b-40d5-b413-0191fa084e4b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:56.115711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02e1ee6670d4104bd3d079c86bbf056', 'request_id': 'req-bb041631-5e2b-40d5-b413-0191fa084e4b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:56.168221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89a5d-d281-41f9-a8ae-6b53493c7cbc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.169116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89a5d-d281-41f9-a8ae-6b53493c7cbc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.169116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89a5d-d281-41f9-a8ae-6b53493c7cbc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.177415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 861/1728] 10.222.0.60 () {54 vars in 960 bytes} [Mon Jul 11 14:15:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:15:56.181791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.182081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.182539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.253332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:56.255101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:56.279801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02e1ee6670d4104bd3d079c86bbf056', 'request_id': 'req-bb041631-5e2b-40d5-b413-0191fa084e4b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:56.304882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] The token cache is being invalidate because project d02e1ee6670d4104bd3d079c86bbf056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:56.306304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:56.308407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bb041631-5e2b-40d5-b413-0191fa084e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:56.321191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 868/1729] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:55 2022] DELETE /identity/v3/projects/d02e1ee6670d4104bd3d079c86bbf056 => generated 0 bytes in 979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:56.327280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac723a5-0d64-47fb-a60a-fdae2d1c7ffa None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.329745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac723a5-0d64-47fb-a60a-fdae2d1c7ffa None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.330543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac723a5-0d64-47fb-a60a-fdae2d1c7ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.375465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-bac723a5-0d64-47fb-a60a-fdae2d1c7ffa None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:56.379105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bac723a5-0d64-47fb-a60a-fdae2d1c7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:56.441801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 862/1730] 10.222.0.60 () {58 vars in 1057 bytes} [Mon Jul 11 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:56.451535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:56.460744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:56.470869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719cf11-1727-41ae-8981-6ac510f1f40b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:56.497868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:56.502384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.502384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.502384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.502384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:56.523124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:56.539774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:56.560596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 869/1731] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:56.560904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 863/1732] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:56.574352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.574712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.574975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.601990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:56.622079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:56.624923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:56.636635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 870/1733] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:56.641821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:56.669157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8effb-9fc0-4ecf-935d-786335aa1d84 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:56.683279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:56.687636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.689137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.691660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.693343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:56.695459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:56.702898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:56.741127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 864/1734] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:56.746755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:56.762801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b400ce-3caa-49f1-ab1c-3e602e7da810 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:56.776596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:56.777203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:56.777477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:56.777858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:56.778777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:56.780620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:57.119441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:57.127313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 871/1735] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:56 2022] POST /identity/v3/projects => generated 387 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:57.132624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e6c7-640a-4978-b1dd-8179d813661b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:57.165848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:57.267382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:57.268326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.268326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.268624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.269484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:57.272201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:57.376507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 865/1736] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:57 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:57.382435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:57.420510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b5e92-eaf7-4cc8-8730-43712528b159 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:57.459821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:57.469159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.469802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.470328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.471756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:57.478556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:57.528741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 872/1737] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:57.534461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:57.563463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55427b09-0a21-4258-b4b4-9a5d540d19f7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:57.583670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:57.584977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.584977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.584977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.586384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:57.588921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458b3ef-208c-4fce-8318-9dde4de956ab admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:57.618023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 866/1738] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:57.636137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:57.680615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cb69-edbd-49e9-ad21-1eddcba2e7f4 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:57.717606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:57.719361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.719875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.720386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] PATH_INFO: `/v3/projects/212121b5aeb24d098633531cf9f57d54/users/1a93f04d612d4ef8ae39a3dd223f2c04/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.834175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=212121b5aeb24d098633531cf9f57d54, user_id=1a93f04d612d4ef8ae39a3dd223f2c04, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:57.838274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c36213-8140-4601-8ba4-6089f47499fd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:57.957007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.959742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.960472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.975508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 873/1739] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:57 2022] PUT /identity/v3/projects/212121b5aeb24d098633531cf9f57d54/users/1a93f04d612d4ef8ae39a3dd223f2c04/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:57.998346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.998640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.998921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:58.005730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] MFA Rules not processed for user `658611df52f34f87a074a3467a42d4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:58.013222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:58.093235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] MFA Rules not processed for user `1a93f04d612d4ef8ae39a3dd223f2c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:58.097350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:58.165561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:58.197633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 867/1740] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:58.322941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 874/1741] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:58.326914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:58.373355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:58.491928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7793c-a2d6-4999-8437-ae4607ce61ce None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:58.503055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:58.503966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:58.504405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:58.504836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:58.506114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:58.520133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192a9ed-44d8-42ac-8369-50ef82829e01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:58.684360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 868/1742] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:58 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:58.688237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:58.710876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179afd48-7eb5-4fe4-9a50-2fa39c8a88bc None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:58.843487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa0cc-ad7f-4be4-b2f1-20e4016168f1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:58.843881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa0cc-ad7f-4be4-b2f1-20e4016168f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:58.844243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa0cc-ad7f-4be4-b2f1-20e4016168f1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:58.846075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 869/1743] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:15:58.905711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:58.906561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:58.906678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:58.907020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:58.907693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:58.913782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:59.034746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:59.035215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:59.035639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:59.088123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:59.089769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:59.100197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 875/1744] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:58 2022] POST /identity/v3/users => generated 300 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:59.104151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:59.149246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f497ea-2a38-4fc1-9a48-3169e6593fb7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:59.186483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:59.187308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:59.187597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:59.187876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:59.188628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:59.205239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e48f1-b26a-425c-9b0c-5597c96b0a1c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:59.267172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 876/1745] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:59.280172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:59.280550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:59.286723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:59.400408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] MFA Rules not processed for user `95a0d5d3971a41c1ab6f65b953661393`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:59.401799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:59.472160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 870/1746] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:59.480051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:59.555654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f77312-5c65-4094-9a9d-a28ad11a98dd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:59.617767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:59.628035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:59.628322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:59.634843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] PATH_INFO: `/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480/users/7366bcd3b3724b9883c6624cafc2562a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:59.727057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b27b77a5fb4ceb98c8673ca97c6480, user_id=7366bcd3b3724b9883c6624cafc2562a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:59.738393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:59.792507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 877/1747] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:59.793533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:59.806366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:59.867256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 871/1748] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:59 2022] PUT /identity/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480/users/7366bcd3b3724b9883c6624cafc2562a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:59.869081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada5c39-c16d-4176-9d4a-31e84fe2340c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:59.869664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:00.106381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f270-e267-43b0-b10a-0d07d7fc5bcb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:00.117898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:00.125186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.125476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.125790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.135668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:00.136385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.136666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.136999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.137733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:00.139369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:00.158231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:00.159861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2305-ccf8-469c-9e99-c58c9b2da0ea service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:00.198038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 872/1749] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:00.199685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:00.211287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 878/1750] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:00.233682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d895e-1adc-471d-a7fb-7b497ef98c0b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:00.253884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:00.256036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.256551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.257186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] PATH_INFO: `/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480/users/7366bcd3b3724b9883c6624cafc2562a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.262106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b27b77a5fb4ceb98c8673ca97c6480, user_id=7366bcd3b3724b9883c6624cafc2562a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:00.268686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:00.297435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 873/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:00 2022] PUT /identity/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480/users/7366bcd3b3724b9883c6624cafc2562a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:00.314749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.315258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.315690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.412743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:00.414247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] MFA Rules not processed for user `7366bcd3b3724b9883c6624cafc2562a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:00.419658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:00.706658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 879/1752] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:00.731711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:00.734131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:00.866949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10876f-724b-416b-bb76-f5d7cfa6c41c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:00.871484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:00.872280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.872454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.872917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.907241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:00.909164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce445e46-022c-4ac9-b8b9-84fc502fb910 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:00.935132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:00.960845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 874/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:01.017106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:01.309053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040f9f-9d00-4ffd-a9f3-884c72583881 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:01.326041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:01.329831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:01.331795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:01.332344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] PATH_INFO: `/v3/users/1a93f04d612d4ef8ae39a3dd223f2c04` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:01.335833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a93f04d612d4ef8ae39a3dd223f2c04)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:01.339446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:01.796658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a93f04d612d4ef8ae39a3dd223f2c04'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:01.864629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a93f04d612d4ef8ae39a3dd223f2c04'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:01.886214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a93f04d612d4ef8ae39a3dd223f2c04'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:01.954547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a93f04d612d4ef8ae39a3dd223f2c04'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:02.119724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a93f04d612d4ef8ae39a3dd223f2c04'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:02.152991 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 880/1754] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:01 2022] DELETE /identity/v3/users/1a93f04d612d4ef8ae39a3dd223f2c04 => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:02.158577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47971-f87a-4807-a03a-9c0a29419bcb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:02.159111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47971-f87a-4807-a03a-9c0a29419bcb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:02.159111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47971-f87a-4807-a03a-9c0a29419bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:02.229813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e5c47971-f87a-4807-a03a-9c0a29419bcb None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:02.231197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e5c47971-f87a-4807-a03a-9c0a29419bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:02.446175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 875/1755] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:02.455507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:02.457890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:02.661437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea020b7-48cd-48ae-bea4-ce69ef03856c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:02.678990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:02.679988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:02.680335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:02.680624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:02.743928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:02.743928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac000ed8-23a9-467b-b31f-691adaa49b77 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:02.767456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 881/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:03.144027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:03.144324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:03.144660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:03.205424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] MFA Rules not processed for user `cb30fcf6e0494463a3172bb37e38ab85`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:03.211237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:03.458127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:03.500961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 876/1757] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:03.748022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:03.748775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:03.749275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:03.839012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:03.840554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:03.871815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:03.874814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:03.881127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f003-bca1-4fc2-9488-5c629c828f43 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:03.897648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:03.915386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:03.916295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:03.916862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] PATH_INFO: `/v3/users/97fc067a39d441df9d181e5840464648` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:03.922049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fc067a39d441df9d181e5840464648)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:03.926971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:04.064725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 882/1758] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:16:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:04.350224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:04.373168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fc067a39d441df9d181e5840464648'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:04.374573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fc067a39d441df9d181e5840464648'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:04.394938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fc067a39d441df9d181e5840464648'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:04.427819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fc067a39d441df9d181e5840464648'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:04.503339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fc067a39d441df9d181e5840464648'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:04.519454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 877/1759] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:03 2022] DELETE /identity/v3/users/97fc067a39d441df9d181e5840464648 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:04.744548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:04.746842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:04.955933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37c0f5-e3e0-4715-9944-8154d5857ba7 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:05.102478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:05.103559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:05.103776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:05.105895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:05.109019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:05.205913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:05.207752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:05.238330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 883/1760] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:05.309061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:05.310680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:05.414767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:05.530947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4afa-17f1-4851-b300-7f815a28907d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:05.545816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:05.550367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:05.550367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:05.550367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] PATH_INFO: `/v3/projects/53f6576b3d824b83af66b9ff6ca8ce01` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:05.550367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f6576b3d824b83af66b9ff6ca8ce01)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:05.551610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:05.720236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f6576b3d824b83af66b9ff6ca8ce01', 'request_id': 'req-0c678996-e0d9-4ba4-bbff-7477d25c2664'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:05.735696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f6576b3d824b83af66b9ff6ca8ce01', 'request_id': 'req-0c678996-e0d9-4ba4-bbff-7477d25c2664'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:05.837418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f6576b3d824b83af66b9ff6ca8ce01', 'request_id': 'req-0c678996-e0d9-4ba4-bbff-7477d25c2664'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:05.864573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] The token cache is being invalidate because project 53f6576b3d824b83af66b9ff6ca8ce01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:05.865234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:05.870240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:05.879578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 878/1761] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:05 2022] DELETE /identity/v3/projects/53f6576b3d824b83af66b9ff6ca8ce01 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:05.883721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:05.906894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa55e4-8468-4d6b-b1be-519019ed5af3 service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:06.088318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:06.090203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:06.090730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:06.091159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] PATH_INFO: `/v3/users/dbcad65f419a48b5989e92db7750e0a9` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:06.094388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbcad65f419a48b5989e92db7750e0a9)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:06.099833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:06.540270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbcad65f419a48b5989e92db7750e0a9'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.555680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbcad65f419a48b5989e92db7750e0a9'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.558140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbcad65f419a48b5989e92db7750e0a9'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.572165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:06.574236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:06.592393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbcad65f419a48b5989e92db7750e0a9'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.598443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c678996-e0d9-4ba4-bbff-7477d25c2664 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:06.617548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:06.617548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:06.617548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:06.617548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] PATH_INFO: `/v3/users/9017a0f4d3b244b387dcc25c9b1aefcd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:06.618975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9017a0f4d3b244b387dcc25c9b1aefcd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:06.621203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:06.675955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbcad65f419a48b5989e92db7750e0a9'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.722809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 884/1762] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:05 2022] DELETE /identity/v3/users/dbcad65f419a48b5989e92db7750e0a9 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:06.913040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:06.954631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9017a0f4d3b244b387dcc25c9b1aefcd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:06.993206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9017a0f4d3b244b387dcc25c9b1aefcd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.006981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9017a0f4d3b244b387dcc25c9b1aefcd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.048780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:07.050858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:07.085068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9017a0f4d3b244b387dcc25c9b1aefcd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.188936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b3ccd24-c43f-4bdb-a67f-67e4d18926b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9017a0f4d3b244b387dcc25c9b1aefcd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.200254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 879/1763] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:06 2022] DELETE /identity/v3/users/9017a0f4d3b244b387dcc25c9b1aefcd => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:07.204327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7e9d-8bda-41a2-94e2-7fbdb81ca17f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:07.204627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7e9d-8bda-41a2-94e2-7fbdb81ca17f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:07.204913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7e9d-8bda-41a2-94e2-7fbdb81ca17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:07.280840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-686d7e9d-8bda-41a2-94e2-7fbdb81ca17f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:07.282485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-686d7e9d-8bda-41a2-94e2-7fbdb81ca17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:07.312983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c9c8-fde7-4fde-897b-ab6ebef00e60 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:07.469299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:07.470629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:07.471153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:07.471645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] PATH_INFO: `/v3/projects/212121b5aeb24d098633531cf9f57d54` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:07.473929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] RBAC: Authorizing `identity:delete_project(project_id=212121b5aeb24d098633531cf9f57d54)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:07.478367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:07.517322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 880/1764] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:07.522980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:07.524955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:07.526156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:07.594069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:07.604113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:07.757041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 881/1765] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Jul 11 14:16:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:07.758304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:07.760802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212121b5aeb24d098633531cf9f57d54', 'request_id': 'req-f07da08d-8a5c-42f2-b658-fb58183c267a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.767164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:07.777809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212121b5aeb24d098633531cf9f57d54', 'request_id': 'req-f07da08d-8a5c-42f2-b658-fb58183c267a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.819973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb296aa-024d-43fb-827b-b48b8f4d02a9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:07.932737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212121b5aeb24d098633531cf9f57d54', 'request_id': 'req-f07da08d-8a5c-42f2-b658-fb58183c267a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.946092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:07.947324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] The token cache is being invalidate because project 212121b5aeb24d098633531cf9f57d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:07.947567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:07.948173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:07.948703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:07.949230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.952574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:07.954661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 885/1766] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:07 2022] DELETE /identity/v3/projects/212121b5aeb24d098633531cf9f57d54 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:07.960350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:07.962078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:08.070047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:08.107055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:08.107055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 882/1767] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:08.107055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:08.113893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14927af-c157-4ca9-958b-b87e93710202 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:08.120990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:08.121780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:08.122449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:08.122911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:08.127340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:08.144626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:08.147198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:08.168478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 883/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:08.214530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07da08d-8a5c-42f2-b658-fb58183c267a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:08.236813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:08.238778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:08.239245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:08.239707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] PATH_INFO: `/v3/users/7366bcd3b3724b9883c6624cafc2562a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:08.241994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7366bcd3b3724b9883c6624cafc2562a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:08.247511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:08.250598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:08.533492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:08.536225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:08.578272 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38e8d-c5ac-4d66-ae88-af41f6fdb47a service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:08.589421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:08.590135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7366bcd3b3724b9883c6624cafc2562a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.590531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:08.590825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:08.591113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] PATH_INFO: `/v3/projects/bdf446fa944f4499834abd142c9a0b77` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:08.595579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf446fa944f4499834abd142c9a0b77)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:08.613842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:08.618856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7366bcd3b3724b9883c6624cafc2562a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.669236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7366bcd3b3724b9883c6624cafc2562a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.669236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7366bcd3b3724b9883c6624cafc2562a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.783408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-38cb416e-d3fa-4cd1-a62e-3bc79c5336e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7366bcd3b3724b9883c6624cafc2562a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.795037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 886/1769] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:07 2022] DELETE /identity/v3/users/7366bcd3b3724b9883c6624cafc2562a => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:08.851556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf446fa944f4499834abd142c9a0b77', 'request_id': 'req-7a48377b-e6be-4be8-84b4-d618a4211b75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:08.865540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf446fa944f4499834abd142c9a0b77', 'request_id': 'req-7a48377b-e6be-4be8-84b4-d618a4211b75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:09.107696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf446fa944f4499834abd142c9a0b77', 'request_id': 'req-7a48377b-e6be-4be8-84b4-d618a4211b75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:09.127265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] The token cache is being invalidate because project bdf446fa944f4499834abd142c9a0b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:09.134644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:09.134644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7a48377b-e6be-4be8-84b4-d618a4211b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:09.134644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 884/1770] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:08 2022] DELETE /identity/v3/projects/bdf446fa944f4499834abd142c9a0b77 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:09.136714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:09.137054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:09.137939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:09.187528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:09.189009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:09.332634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:09.470645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 887/1771] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:09.665526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 885/1772] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:09.667370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:09.667370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ecec6-e2f0-48b2-be7b-b5fe241ee1e8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:09.667370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:09.667370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:09.667943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 888/1773] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:09.668792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:09.668792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f71257-b43b-40f8-b252-9d05016cb5a9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:09.668792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:09.668792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:09.669386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:09.669386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:09.669386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:09.669386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:09.912394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 886/1774] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:09 2022] POST /identity/v3/projects => generated 407 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:09.914275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:09.930243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa4ef-b1ce-4037-bc12-0f4205b16f29 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:10.093010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:10.105719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:10.105719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:10.105719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:10.105719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:10.106540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:10.108911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:10.201166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 889/1775] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:09 2022] POST /identity/v3/users => generated 304 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:10.206026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:10.225962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d44c-0c79-4a57-b133-f6b8c66ebfdb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:10.240608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:10.241730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:10.242211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:10.242658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:10.243617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:10.248609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:10.281398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 887/1776] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:10.286068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:10.303242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12fb4-b21c-476e-9e76-4f8f6d791017 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:10.317305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:10.318558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:10.319073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:10.319567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:10.322051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:10.327401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485e048-7827-4c6c-822b-cc1bfb21c4c3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:10.381801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 890/1777] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:10.386692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:10.404926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb0f2-5aca-4a6a-bd13-1b846d8c8a7c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:10.421293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:10.424388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:10.424388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:10.424388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] PATH_INFO: `/v3/projects/5af0e2f01e5d42149113dbb6f6ecb0d8/users/2b201cb17ab84ec3a281f4ecec632815/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:10.478008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af0e2f01e5d42149113dbb6f6ecb0d8, user_id=2b201cb17ab84ec3a281f4ecec632815, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:10.490933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:10.596393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 888/1778] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:10 2022] PUT /identity/v3/projects/5af0e2f01e5d42149113dbb6f6ecb0d8/users/2b201cb17ab84ec3a281f4ecec632815/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:10.597424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:10.597939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:10.598028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:10.679059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] MFA Rules not processed for user `2b201cb17ab84ec3a281f4ecec632815`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:10.692598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:11.045899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:11.068620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 891/1779] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:11.196231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea483-3aa9-45ef-b52a-2ce16675e2b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:11.207077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:11.208362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:11.209175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:11.209547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:11.210940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:11.213890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:11.476833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.508379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 889/1780] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:11 2022] POST /identity/v3/projects => generated 407 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:11.513072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:11.533857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30af15-c3dd-40b5-aed8-01c5ec3c279c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:11.617904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.726839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:11.727746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:11.728048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:11.728331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:11.729041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:11.732295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.051962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 892/1781] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:11 2022] POST /identity/v3/users => generated 310 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:12.052165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.052165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:12.056237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.073510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b707c8-c3df-462d-ad0c-adeb44a02af5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.080870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:12.084740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.095547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.095547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] PATH_INFO: `/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.095547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b27b77a5fb4ceb98c8673ca97c6480)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:12.095547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.121500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dcc2-58bf-43fe-882c-b3099ed38edb admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.143799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:12.148907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.150583 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.158159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.158159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:12.158159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.193395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 893/1782] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:12.194828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.209201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6378-b98d-41a1-83fd-24833868a634 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.218091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:12.219082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.219297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.219832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] PATH_INFO: `/v3/projects/818c541974b548109297ab8156873e38/users/3046951e997d48f7ad51c19a6f445768/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.319262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c541974b548109297ab8156873e38, user_id=3046951e997d48f7ad51c19a6f445768, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:12.337308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.353472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b27b77a5fb4ceb98c8673ca97c6480', 'request_id': 'req-096a08f9-e25d-40f5-b00e-f3becafb741d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:12.387167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b27b77a5fb4ceb98c8673ca97c6480', 'request_id': 'req-096a08f9-e25d-40f5-b00e-f3becafb741d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:12.427133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 894/1783] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:12 2022] PUT /identity/v3/projects/818c541974b548109297ab8156873e38/users/3046951e997d48f7ad51c19a6f445768/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:12.433849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.480820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b27b77a5fb4ceb98c8673ca97c6480', 'request_id': 'req-096a08f9-e25d-40f5-b00e-f3becafb741d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:12.511422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] The token cache is being invalidate because project 42b27b77a5fb4ceb98c8673ca97c6480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:12.512590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:12.522478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-096a08f9-e25d-40f5-b00e-f3becafb741d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:12.533623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 890/1784] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:12 2022] DELETE /identity/v3/projects/42b27b77a5fb4ceb98c8673ca97c6480 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:12.541072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc50d8-dd73-4ef7-80d5-6625e2400582 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.541475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc50d8-dd73-4ef7-80d5-6625e2400582 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.542436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc50d8-dd73-4ef7-80d5-6625e2400582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.584340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f7df-8bcc-4395-b23c-03cb29b8846f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.590701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-92cc50d8-dd73-4ef7-80d5-6625e2400582 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:12.593416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-92cc50d8-dd73-4ef7-80d5-6625e2400582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:12.600353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:12.601420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.601893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.607578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.607578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:12.607578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.616231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 891/1785] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:12.627784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.632412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.632412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.635881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 895/1786] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:16:12.637038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.643236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:12.680023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:12.682951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:12.683830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7e22d-b92d-494f-903e-d056c7a87164 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.706954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 892/1787] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:12.711069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:12.711069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.711069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.711069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] PATH_INFO: `/v3/projects/818c541974b548109297ab8156873e38/users/3046951e997d48f7ad51c19a6f445768/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.712066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:12.722128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c541974b548109297ab8156873e38, user_id=3046951e997d48f7ad51c19a6f445768, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:12.725425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bacae-cacb-4b15-9f2e-1fff833d0459 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:12.760626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f63850-c2be-4cc9-932e-c506ff665945 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:12.771890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 896/1788] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:12 2022] PUT /identity/v3/projects/818c541974b548109297ab8156873e38/users/3046951e997d48f7ad51c19a6f445768/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:12.783153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:12.783470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:12.783823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:12.882855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] MFA Rules not processed for user `3046951e997d48f7ad51c19a6f445768`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:12.884380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:13.007985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:13.009670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:13.009963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:13.010247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:13.023997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:13.023997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:13.024867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:13.093388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 893/1789] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:13.096258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:13.097418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 897/1790] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:13.110622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:13.112759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:13.149935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c57e11-214f-4d75-bc25-a1878b62457b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:13.164761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:13.166421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:13.168380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:13.168904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:13.171963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:13.176357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:13.221487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:13.272474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:13.296547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd3b6-5793-46fa-8ff7-47f64bac046f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:13.308188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:13.309725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:13.310388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:13.310826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:13.341009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:13.343114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:13.366635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 898/1791] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:13.368863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:13.383637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:13.442906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057844-3246-40c2-8c80-f7a8c420d356 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:13.461094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:13.462020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:13.462347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:13.462562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] PATH_INFO: `/v3/projects/dc1190399a164a4b8f4397a7fdb4d8a1` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:13.464613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1190399a164a4b8f4397a7fdb4d8a1)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:13.467273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:13.683694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 894/1792] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:13 2022] POST /identity/v3/projects => generated 385 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:13.687193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:13.787298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1190399a164a4b8f4397a7fdb4d8a1', 'request_id': 'req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:13.808070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1190399a164a4b8f4397a7fdb4d8a1', 'request_id': 'req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:13.892796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2aeb9-ca43-40a5-a7d5-5ee48012b6bf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:13.915305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1190399a164a4b8f4397a7fdb4d8a1', 'request_id': 'req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:13.939136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] The token cache is being invalidate because project dc1190399a164a4b8f4397a7fdb4d8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:13.941550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:13.942584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:13.947975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 899/1793] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:13 2022] DELETE /identity/v3/projects/dc1190399a164a4b8f4397a7fdb4d8a1 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:13.968165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:13.972772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:14.137193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:14.137904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:14.138201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:14.138471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:14.139236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:14.141276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:14.237357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b0ca-ef8c-4cd2-ab84-48243f8d2857 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:14.252999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:14.253939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:14.254413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:14.254832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] PATH_INFO: `/v3/users/eed8908ff5244d1f8ebbec31d1bfca93` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:14.257594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed8908ff5244d1f8ebbec31d1bfca93)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:14.260494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:14.379481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 895/1794] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:13 2022] POST /identity/v3/users => generated 293 bytes in 690 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:14.381771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:14.387450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:14.534425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed8908ff5244d1f8ebbec31d1bfca93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:14.558151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed8908ff5244d1f8ebbec31d1bfca93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:14.565014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed8908ff5244d1f8ebbec31d1bfca93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:14.586194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402de4fd-27f5-4dcb-be0e-9fdf1047b53f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:14.596615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:14.597382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:14.597693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:14.597973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:14.602411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:14.615414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed8908ff5244d1f8ebbec31d1bfca93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:14.820195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:14.824848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:14.864442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 896/1795] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:14.871871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:14.875912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:14.947309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9ef40-3a40-4a74-b0de-70c7ed470492 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:14.963603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:14.964960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:14.965258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:14.965663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:14.966504 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:14.968150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:14.979309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed8908ff5244d1f8ebbec31d1bfca93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:15.004397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 900/1796] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:13 2022] DELETE /identity/v3/users/eed8908ff5244d1f8ebbec31d1bfca93 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:15.016283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 897/1797] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:15.019587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:15.022610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:15.440197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c254-025e-4fa8-8a19-bb6d1460bcff admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:15.440197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:15.440197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.440197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.441472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.441472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:15.447978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4413bbf-71c4-45ff-8309-23fd007ee398 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:15.471022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 901/1798] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:16:15.478854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:15.492467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b806ee-cfc3-4c15-88e0-f0a08d4e0291 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:15.502451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:15.503893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.504461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.504987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] PATH_INFO: `/v3/projects/6d160bc0745a46e589eee39546d61f05/users/c80199233fb640cfaab047b5c39f11d2/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.526553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d160bc0745a46e589eee39546d61f05, user_id=c80199233fb640cfaab047b5c39f11d2, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:15.531141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b84dc-c000-4019-9657-92c7414bc56d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:15.555433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b011-f2db-466e-b06c-d82376797a2c None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.556182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b011-f2db-466e-b06c-d82376797a2c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.556842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b011-f2db-466e-b06c-d82376797a2c None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.558868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 902/1799] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:16:15.578154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:15.607453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 898/1800] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:15 2022] PUT /identity/v3/projects/6d160bc0745a46e589eee39546d61f05/users/c80199233fb640cfaab047b5c39f11d2/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:15.622497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.622928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.623387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.706803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] MFA Rules not processed for user `c80199233fb640cfaab047b5c39f11d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:15.711868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:15.822854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8e70-45e1-4df2-83a2-9b60035e911d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.822854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8e70-45e1-4df2-83a2-9b60035e911d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.823181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8e70-45e1-4df2-83a2-9b60035e911d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.825083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 899/1801] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:16:15.897047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae396-35af-4307-9b65-eaa13c18c8e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:15.903848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae396-35af-4307-9b65-eaa13c18c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:15.903848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae396-35af-4307-9b65-eaa13c18c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:15.937843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 903/1802] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:15.943779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:15.944858 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-006ae396-35af-4307-9b65-eaa13c18c8e9 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:15.954730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-006ae396-35af-4307-9b65-eaa13c18c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:16.065029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 900/1803] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:16:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 14:16:16.072058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:16.072351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:16.072635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:16.123819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:16.127543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:16.155112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 901/1804] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:16.277561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937078d-7a82-4908-aec4-91c75e3b46ef None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:16.301557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:16.315508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:16.316286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:16.316589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:16.316934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:16.323924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:16.326591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:16.473766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 904/1805] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:16.476021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:16.506221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271958b-fc10-4b08-9a9e-11f780d26b5b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:16.682417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:16.691433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:16.691433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:16.691433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:16.691433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:16.691433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.120373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 902/1806] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:16 2022] POST /identity/v3/users => generated 299 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:17.124768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.145235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ce3f-d96a-453d-b72d-fd25474cd0e7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.169714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.170525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.170816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.171093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.171850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.173491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.246907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 905/1807] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:17.284634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.307672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9799a2d-e639-4118-b490-c854e0b6d4ef admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.324081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.330934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.335012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.335012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] PATH_INFO: `/v3/projects/d0afd0710981483488bdcbd3220e7e26/users/29d20f18cd614f9d80a07f47af0418d3/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.368863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0afd0710981483488bdcbd3220e7e26, user_id=29d20f18cd614f9d80a07f47af0418d3, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.377149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.468205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 903/1808] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:17 2022] PUT /identity/v3/projects/d0afd0710981483488bdcbd3220e7e26/users/29d20f18cd614f9d80a07f47af0418d3/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:17.476836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.498496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d598a-a2ba-41e2-bc4d-c7c1d7dd5aaa admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.564021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.566062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:17.677098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.684922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.685781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.687997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.689890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.692507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.742284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 906/1809] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:17.743806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.754903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af395-c13a-44bd-92f3-b0a27df30cf2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.771720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c889013-90e8-4c58-a438-f302fdbdc94a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.774969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.775708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.775998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.777276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.787937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.791283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.791283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.791283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] PATH_INFO: `/v3/projects/d0afd0710981483488bdcbd3220e7e26/users/29d20f18cd614f9d80a07f47af0418d3/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.805349 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0afd0710981483488bdcbd3220e7e26, user_id=29d20f18cd614f9d80a07f47af0418d3, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.811061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.812069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685e55-525c-4c14-8f78-74401d0b6ee0 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.817271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.853770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 904/1810] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:17.871865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 907/1811] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:17 2022] PUT /identity/v3/projects/d0afd0710981483488bdcbd3220e7e26/users/29d20f18cd614f9d80a07f47af0418d3/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:17.877449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.877449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.877449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.951102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] MFA Rules not processed for user `29d20f18cd614f9d80a07f47af0418d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:17.952425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:17.992103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.995701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:18.231166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd62a5-15b5-4221-90a3-6eff2c51d398 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:18.257136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:18.258139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:18.260107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:18.261146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:18.277942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 905/1812] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:18.283649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:18.285761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:18.301894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:18.307766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:18.312360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:18.347093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 908/1813] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:18.449805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d539-7d44-4533-b0fd-2173afd5e0d6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:18.463331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:18.464066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:18.464385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:18.464664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:18.577222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:18.578977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95396c6d-d703-4b2f-a02a-fabc555dcc91 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:18.598686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:18.598686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:18.608306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 906/1814] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:18.876877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc30609-c006-4fb7-b221-fcce435ffbc3 service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:18.901639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:18.902879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:18.903397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:18.903998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] PATH_INFO: `/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:18.906006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ddabb2fe5440f3a5c69dc3616c0ead)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:18.908387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:18.966771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:19.238371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ddabb2fe5440f3a5c69dc3616c0ead', 'request_id': 'req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:19.262927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ddabb2fe5440f3a5c69dc3616c0ead', 'request_id': 'req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:19.366287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ddabb2fe5440f3a5c69dc3616c0ead', 'request_id': 'req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:19.392174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] The token cache is being invalidate because project 68ddabb2fe5440f3a5c69dc3616c0ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:19.393216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:19.395578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0ad660bf-7b89-4b90-afd4-4ec61a8d51ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:19.399614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 909/1815] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:18 2022] DELETE /identity/v3/projects/68ddabb2fe5440f3a5c69dc3616c0ead => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:19.406692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c650-785b-41b6-b755-37635d872872 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:19.406692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c650-785b-41b6-b755-37635d872872 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:19.406692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c650-785b-41b6-b755-37635d872872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:19.441157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1172c650-785b-41b6-b755-37635d872872 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:19.441157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1172c650-785b-41b6-b755-37635d872872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:19.523248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 907/1816] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:19.531139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:19.531436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:19.531739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:19.583411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:19.585934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:19.610804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 910/1817] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:19.615288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c650-785b-41b6-b755-37635d872872 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:19.648764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c650-785b-41b6-b755-37635d872872 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:19.666289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:19.670649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:19.670649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:19.670649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:19.670649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:19.670649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:19.671490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:19.709562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:19.712633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 908/1818] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:19.725776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599cdd-1cdf-4c69-af3d-5ae2dbc31a34 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:19.734001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:19.736078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:19.736616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:19.737304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:19.738369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:19.742544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:19.954560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 911/1819] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:19 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:19.960417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:19.981831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c6d09-c2d9-4b99-8ca4-7371cacc35d3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:20.128348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:20.134599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:20.134599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:20.134884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:20.135626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:20.137734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:20.347305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 909/1820] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:19 2022] POST /identity/v3/users => generated 283 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:20.352180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:20.369638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218eab2-4635-45ee-b863-85e875343e11 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:20.382052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:20.383079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:20.383560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:20.384045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:20.385772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:20.391490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:20.418218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 912/1821] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:20.422317 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:20.445907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940699c-8086-44a6-9728-c3eba66c622d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:20.463297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:20.465162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:20.469140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:20.470668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:20.519664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:20.519664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39826ae4-23ae-469c-9c24-390dfbd6991a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:20.526981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 910/1822] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:20.535738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:20.549420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5753b2a-1693-449b-a89d-ed00fe02115d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:20.557810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:20.559180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:20.559787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:20.560345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] PATH_INFO: `/v3/projects/4326748ab3874c25a4d00c2a33ccc305/users/83458aafac384846bf708f3e99bfc375/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:20.582835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4326748ab3874c25a4d00c2a33ccc305, user_id=83458aafac384846bf708f3e99bfc375, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:20.586977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:20.702720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 913/1823] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:20 2022] PUT /identity/v3/projects/4326748ab3874c25a4d00c2a33ccc305/users/83458aafac384846bf708f3e99bfc375/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:20.715303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:20.715862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:20.716360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:20.774281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] MFA Rules not processed for user `83458aafac384846bf708f3e99bfc375`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:20.781028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:20.923593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:20.925214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 911/1824] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:21.054288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2068ee-b821-40fb-99c7-353f9d593964 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:21.071048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:21.071957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:21.072360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:21.072832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:21.073731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:21.078812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:21.230361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 914/1825] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:20 2022] POST /identity/v3/projects => generated 365 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:21.235164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:21.250077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4a294-c7e9-470c-9a3e-4b24cff52e8d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:21.357515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:21.365309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:21.365309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:21.365309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:21.365309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:21.365309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:21.465856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 912/1826] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:21 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:21.470159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:21.492289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f97c-8824-44e1-9c07-24ac4072a9c3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:21.510131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:21.510827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:21.511158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:21.511440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:21.512304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:21.516856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:21.645709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 915/1827] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:21.648567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:21.648567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89b1c-55bc-4f1b-a307-78dc261ef835 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:21.648567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:21.648567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:21.649075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:21.649075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] PATH_INFO: `/v3/projects/759ebae949b24dab90053a304cc5c9a4/users/dadd86e8eff3435883f0edb4ad5cbc89/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:21.649075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759ebae949b24dab90053a304cc5c9a4, user_id=dadd86e8eff3435883f0edb4ad5cbc89, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:21.649075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:21.914150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 913/1828] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:21 2022] PUT /identity/v3/projects/759ebae949b24dab90053a304cc5c9a4/users/dadd86e8eff3435883f0edb4ad5cbc89/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:21.918357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:21.930131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fe5a6-dcae-4211-801f-52877b3c18ae admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:22.033321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:22.034193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:22.034485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:22.034765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:22.036410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:22.039481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44188b40-eff2-433e-909d-88f553774495 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:22.054635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 916/1829] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:22.063187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:22.070417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8daed4-2e2a-4f01-9ea0-70ca07311085 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:22.075992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:22.077021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:22.077367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:22.077733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] PATH_INFO: `/v3/projects/759ebae949b24dab90053a304cc5c9a4/users/dadd86e8eff3435883f0edb4ad5cbc89/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:22.080057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=759ebae949b24dab90053a304cc5c9a4, user_id=dadd86e8eff3435883f0edb4ad5cbc89, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:22.083503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:22.097842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 914/1830] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:22 2022] PUT /identity/v3/projects/759ebae949b24dab90053a304cc5c9a4/users/dadd86e8eff3435883f0edb4ad5cbc89/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:22.107515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:22.107813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:22.108100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:22.143558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] MFA Rules not processed for user `dadd86e8eff3435883f0edb4ad5cbc89`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:22.145024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:22.231767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 917/1831] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:22.244749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:22.246348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:22.264290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:22.310907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c5b27-fd8a-4b9e-8bcc-931de1c940ae admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:22.314139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:22.314797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:22.315077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:22.315355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:22.334863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:22.336773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:22.348469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 915/1832] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:22.372613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:22.704749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:22.706843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:22.725879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6462a-4558-4d2e-8147-33974f754cc1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:22.749198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:22.749198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:22.749198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:22.749198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:22.816217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:22.817760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c1b45-908d-44d6-8aa8-8667afa93339 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:22.828332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 918/1833] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:23.378039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:24.556064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:24.557726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:24.639136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65905f62-ab30-44b6-aef6-881696f66d7e service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:24.661361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:24.662807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:24.663195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:24.663480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] PATH_INFO: `/v3/users/2b201cb17ab84ec3a281f4ecec632815` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:24.664715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b201cb17ab84ec3a281f4ecec632815)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:24.666695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:24.992967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b201cb17ab84ec3a281f4ecec632815'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:24.999017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b201cb17ab84ec3a281f4ecec632815'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:25.001114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b201cb17ab84ec3a281f4ecec632815'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:25.016025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b201cb17ab84ec3a281f4ecec632815'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:25.172043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b201cb17ab84ec3a281f4ecec632815'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:25.183290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 916/1834] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:24 2022] DELETE /identity/v3/users/2b201cb17ab84ec3a281f4ecec632815 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:25.189443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.190268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.190890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.212056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:25.221668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.295223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 919/1835] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:25.306266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:25.307758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.373676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafea8e5-b68b-4b77-9ba7-2df0eb2a9aa1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:25.376612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:25.377268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.377559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.377908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.388472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:25.390161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:25.404584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 917/1836] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:25.527163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:25.584040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:25.858463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:25.861304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.868134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:25.869690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.899782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820423-6b56-4b74-899b-fb91e8c449f8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:25.913424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:25.913616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.913941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.914713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] PATH_INFO: `/v3/projects/5af0e2f01e5d42149113dbb6f6ecb0d8` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.916336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af0e2f01e5d42149113dbb6f6ecb0d8)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:25.918400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:25.945920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d7a-ac1e-45db-951d-a6d7f4e34eb6 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:25.953546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:25.960003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.960003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.960003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.960003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:26.050584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af0e2f01e5d42149113dbb6f6ecb0d8', 'request_id': 'req-cdaefd09-699b-4cf4-9d5e-faab79d79b09'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.051830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:26.058296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:26.064215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af0e2f01e5d42149113dbb6f6ecb0d8', 'request_id': 'req-cdaefd09-699b-4cf4-9d5e-faab79d79b09'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.071126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 918/1837] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:26.114869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af0e2f01e5d42149113dbb6f6ecb0d8', 'request_id': 'req-cdaefd09-699b-4cf4-9d5e-faab79d79b09'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.129614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] The token cache is being invalidate because project 5af0e2f01e5d42149113dbb6f6ecb0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:26.129997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.131469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.133450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 920/1838] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:25 2022] DELETE /identity/v3/projects/5af0e2f01e5d42149113dbb6f6ecb0d8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:26.137716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:26.152895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311b1a0-1df4-438c-90b2-1479f00ffe66 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:26.219472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:26.220413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:26.220727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:26.221002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] PATH_INFO: `/v3/users/3046951e997d48f7ad51c19a6f445768` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:26.222255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3046951e997d48f7ad51c19a6f445768)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:26.234314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:26.382987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3046951e997d48f7ad51c19a6f445768'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.383663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3046951e997d48f7ad51c19a6f445768'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.391741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3046951e997d48f7ad51c19a6f445768'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.406180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3046951e997d48f7ad51c19a6f445768'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.492660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbf7de3e-9144-4c27-9fa9-84c1572f6e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3046951e997d48f7ad51c19a6f445768'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:26.502453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 919/1839] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:26 2022] DELETE /identity/v3/users/3046951e997d48f7ad51c19a6f445768 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:26.563366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:26.638551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:26.845705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:26.845705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:26.857871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaefd09-699b-4cf4-9d5e-faab79d79b09 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:26.996451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:26.996451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:26.996451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:26.996451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] PATH_INFO: `/v3/users/83458aafac384846bf708f3e99bfc375` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:26.996844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83458aafac384846bf708f3e99bfc375)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:26.998599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:27.194680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83458aafac384846bf708f3e99bfc375'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.213012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83458aafac384846bf708f3e99bfc375'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.213012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83458aafac384846bf708f3e99bfc375'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.229428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83458aafac384846bf708f3e99bfc375'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.340154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83458aafac384846bf708f3e99bfc375'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.349487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 921/1840] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:26 2022] DELETE /identity/v3/users/83458aafac384846bf708f3e99bfc375 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:27.355313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59010-47b3-4066-8035-44416680d18e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:27.355931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59010-47b3-4066-8035-44416680d18e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:27.356127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59010-47b3-4066-8035-44416680d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:27.380925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7df59010-47b3-4066-8035-44416680d18e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:27.382767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7df59010-47b3-4066-8035-44416680d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:27.468799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 920/1841] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:27.485288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:27.488270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:27.552181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdd09-acca-41e4-81b2-c1266d023d26 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:27.556740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:27.557407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:27.557734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:27.558134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:27.567981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:27.570787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef930ca-54f7-4f53-82cd-cd113718fabd service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:27.581100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 922/1842] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:27.656506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59010-47b3-4066-8035-44416680d18e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:27.658286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7df59010-47b3-4066-8035-44416680d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:27.687307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59010-47b3-4066-8035-44416680d18e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:27.695861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:27.696878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:27.705474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:27.706711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] PATH_INFO: `/v3/projects/818c541974b548109297ab8156873e38` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:27.708672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=818c541974b548109297ab8156873e38)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:27.711311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:27.920187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818c541974b548109297ab8156873e38', 'request_id': 'req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:27.937079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818c541974b548109297ab8156873e38', 'request_id': 'req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.092329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818c541974b548109297ab8156873e38', 'request_id': 'req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.116547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] The token cache is being invalidate because project 818c541974b548109297ab8156873e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:28.116929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.118200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f22ce031-baf0-46b6-85e2-4ce8f2be44fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.122856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 921/1843] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:27 2022] DELETE /identity/v3/projects/818c541974b548109297ab8156873e38 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:28.126552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.127443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.127918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.180822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:28.182599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:28.270227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 923/1844] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:28.286225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.286225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.286626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.313282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:28.314516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:28.322829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 922/1845] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:28.327293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.337947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051aed6-dc4e-448c-845f-06a4777a443a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.342838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.343618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.343996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.344343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.345194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:28.345571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.347298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.365059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 924/1846] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:28.366343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.375928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c69ac-4f3c-4ba1-9e76-c4a732f8e0d8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.380931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.381669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.381970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.382250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.382949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.385003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.426165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.428307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:28.446739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f037d2-c479-4a0a-b8e2-f919891495c6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.451583 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.459546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.459546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.459546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] PATH_INFO: `/v3/projects/4326748ab3874c25a4d00c2a33ccc305` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.459546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4326748ab3874c25a4d00c2a33ccc305)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.459546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.494361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 923/1847] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:28 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:28.500481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.568051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:28.572728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b223b-be23-4ee1-bf4a-5fdf290ddf54 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.577718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.578391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.578664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.578941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.579672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.582583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.613527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4326748ab3874c25a4d00c2a33ccc305', 'request_id': 'req-8197327a-90c9-48d7-8d6d-4b732d7929d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.623204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4326748ab3874c25a4d00c2a33ccc305', 'request_id': 'req-8197327a-90c9-48d7-8d6d-4b732d7929d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.652914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:28.711558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 924/1848] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:28 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:28.712562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.731772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4326748ab3874c25a4d00c2a33ccc305', 'request_id': 'req-8197327a-90c9-48d7-8d6d-4b732d7929d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.761705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ba24-8480-4256-9956-31d4192b1829 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.765572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] The token cache is being invalidate because project 4326748ab3874c25a4d00c2a33ccc305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:28.766426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.770131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:28.773451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 925/1849] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:28 2022] DELETE /identity/v3/projects/4326748ab3874c25a4d00c2a33ccc305 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:28.777548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.781981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:28.827774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.828467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.828790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.829065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.829837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.831811 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.854053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 925/1850] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:28.858550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.863054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:28.877311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a276-2802-437e-9d81-d38ae7fc8886 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.882833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.883644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197327a-90c9-48d7-8d6d-4b732d7929d7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.883943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.884671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.885179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.886689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.888866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.893601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.893601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.893601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.893601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] PATH_INFO: `/v3/users/dadd86e8eff3435883f0edb4ad5cbc89` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.893980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadd86e8eff3435883f0edb4ad5cbc89)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.895248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:28.908212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 926/1851] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:28.912574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:28.931181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebdb85-eb96-48c6-926c-ea2528d006b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:28.936469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:28.937607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:28.938115 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:28.938394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] PATH_INFO: `/v3/projects/ea3f6485cca2409899b45fbee095e98f/users/ffdb1c731915441c8c3daa32feaaf9ce/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:28.956249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3f6485cca2409899b45fbee095e98f, user_id=ffdb1c731915441c8c3daa32feaaf9ce, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:28.962266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00e69-82e8-4613-86d4-e8fb48c3b0e1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.045252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 927/1852] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:28 2022] PUT /identity/v3/projects/ea3f6485cca2409899b45fbee095e98f/users/ffdb1c731915441c8c3daa32feaaf9ce/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:29.056850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.057211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.057508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.094222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] MFA Rules not processed for user `ffdb1c731915441c8c3daa32feaaf9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:29.095629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:29.132432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadd86e8eff3435883f0edb4ad5cbc89'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:29.143297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadd86e8eff3435883f0edb4ad5cbc89'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:29.144118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadd86e8eff3435883f0edb4ad5cbc89'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:29.160276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadd86e8eff3435883f0edb4ad5cbc89'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:29.194752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 928/1853] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:29.199063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.258063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadd86e8eff3435883f0edb4ad5cbc89'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:29.264301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fecd4-a86d-4144-850a-a8fba668172c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.270211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 926/1854] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:28 2022] DELETE /identity/v3/users/dadd86e8eff3435883f0edb4ad5cbc89 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:29.275617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.276502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.276823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.277114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.278117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.280942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.374064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 929/1855] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:29 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:29.378993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.380555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:29.460686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba0302-d2d7-4adb-b148-fe5851a1fbb0 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.547942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.549049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.550415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.550916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.552118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.554668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.634900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 927/1856] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:29 2022] POST /identity/v3/users => generated 300 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:29.638629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.652113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd423e-aab0-4f05-a5c7-61b95f81fdb4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.658836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.659955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.660059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.660338 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.661319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.663848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.679059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 930/1857] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:16:29.680181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.694078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcea2-c942-4ce1-9cc2-78c661200fb5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.698894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.699786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.700071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.700352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] PATH_INFO: `/v3/projects/a87b0daed39441038dd2a4c71994fbb8/users/3a86342bc0b14fbf960225ecebddc121/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.716619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87b0daed39441038dd2a4c71994fbb8, user_id=3a86342bc0b14fbf960225ecebddc121, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.719463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.798710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.802334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:29.819510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 928/1858] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:29 2022] PUT /identity/v3/projects/a87b0daed39441038dd2a4c71994fbb8/users/3a86342bc0b14fbf960225ecebddc121/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:29.825785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.830155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492cc48-9de0-4f3f-aa27-3679960033ab admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.917446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e4468-e179-4836-9708-b803a753449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.918545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4468-e179-4836-9708-b803a753449d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.918860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4468-e179-4836-9708-b803a753449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.919078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4468-e179-4836-9708-b803a753449d admin admin] PATH_INFO: `/v3/projects/759ebae949b24dab90053a304cc5c9a4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.920346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e4468-e179-4836-9708-b803a753449d admin admin] RBAC: Authorizing `identity:delete_project(project_id=759ebae949b24dab90053a304cc5c9a4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.922273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e4468-e179-4836-9708-b803a753449d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.926203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d49f-6a43-4809-9fb8-2a2995a3cfdc admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.932704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.933725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.934019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.934303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.935594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.937854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.950161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 929/1859] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:29.953817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:29.966366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828ca4a-09bb-403e-9e69-b2d6cba6de19 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:29.972034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:29.972984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:29.973276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:29.973554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] PATH_INFO: `/v3/projects/a87b0daed39441038dd2a4c71994fbb8/users/3a86342bc0b14fbf960225ecebddc121/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:29.975851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87b0daed39441038dd2a4c71994fbb8, user_id=3a86342bc0b14fbf960225ecebddc121, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:29.978691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91bde5-10ca-4ee7-9759-6c80ef777ba5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:29.998560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 930/1860] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:29 2022] PUT /identity/v3/projects/a87b0daed39441038dd2a4c71994fbb8/users/3a86342bc0b14fbf960225ecebddc121/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:30.009757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.012430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.012430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.040182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] MFA Rules not processed for user `3a86342bc0b14fbf960225ecebddc121`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:30.041541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.105527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759ebae949b24dab90053a304cc5c9a4', 'request_id': 'req-376e4468-e179-4836-9708-b803a753449d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:30.111648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759ebae949b24dab90053a304cc5c9a4', 'request_id': 'req-376e4468-e179-4836-9708-b803a753449d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:30.161465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 931/1861] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:30.170080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:30.171559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.240499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d3d1f-1d87-437a-aea0-490d6e7f35d2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:30.263401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759ebae949b24dab90053a304cc5c9a4', 'request_id': 'req-376e4468-e179-4836-9708-b803a753449d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:30.277008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] The token cache is being invalidate because project 759ebae949b24dab90053a304cc5c9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:30.277594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:30.278281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-376e4468-e179-4836-9708-b803a753449d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:30.283674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 931/1862] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:29 2022] DELETE /identity/v3/projects/759ebae949b24dab90053a304cc5c9a4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:30.287133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.287797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.289120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.297247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:30.298019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.298242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.298955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.300981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.321539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:30.326446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.390555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:30.392055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bb808-070a-45df-a55a-b3a703f84d30 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:30.403813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 932/1863] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:30.417135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 932/1864] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:30.419550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.420320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.421619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.440299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:30.441506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.450572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 933/1865] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:30.455628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:30.466999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042a5a-7d55-435d-9eb5-9c3a40986cc2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:30.471891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:30.472564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.472844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.473116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.473916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:30.474221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:30.475956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba01ed-f645-47b7-bde8-6b41ee3bbb8e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:30.492706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 933/1866] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:30.498528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:30.511659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037edb0-390b-4ea3-9385-cf70b0f8dc62 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:30.519110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:30.519922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.520303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.520965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.521883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:30.524657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:30.545469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6e-87f4-48c6-b095-299232bd1ed4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.545949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6e-87f4-48c6-b095-299232bd1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.546242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6e-87f4-48c6-b095-299232bd1ed4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.547906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 934/1867] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:16:30.580750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.581954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.582256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.608931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:30.611021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.675916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 934/1868] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:30.682284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:30.722725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 935/1869] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:30.784392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f57b37-25ce-4f74-ad01-0d0eb3a8782b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:30.792529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:30.793288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.793607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.793891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.794647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:30.796679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:30.810314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:30.812732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:30.828047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dab0a-69be-4858-b27f-eae5cd274630 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:30.936163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:30.936842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:30.937171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:30.937403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:30.948622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:30.963035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:30.973818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 936/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:30.986281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:30.996909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 935/1871] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:30 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:30.998690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.011262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd346f-2593-45b2-8bc5-4a7c1d55f0ab service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.016240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.017197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.017550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.017870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.018599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.020268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.031864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 937/1872] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:31.036264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.058715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6624d-c366-4013-a930-02b88dc9cff2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.064585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.065615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.065820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.066622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.067586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.069900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaa6fc-22db-420a-88a5-af5293f65b20 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.085821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 936/1873] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:31.088019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.110610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab4ef-f685-4d61-a810-fdb7f16ee6fa admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.122567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.123593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.124540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.125122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] PATH_INFO: `/v3/projects/d4577f467f1f4a69885e882bbfa7940b/users/6b8e059b2895407d80c0ee29542062f2/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.153626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4577f467f1f4a69885e882bbfa7940b, user_id=6b8e059b2895407d80c0ee29542062f2, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.157119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.243853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 938/1874] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:31 2022] PUT /identity/v3/projects/d4577f467f1f4a69885e882bbfa7940b/users/6b8e059b2895407d80c0ee29542062f2/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:31.244373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.245020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.245327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.281983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] MFA Rules not processed for user `6b8e059b2895407d80c0ee29542062f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:31.283589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:31.389532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 937/1875] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:31.392516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.499071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1a91-2087-4fdb-91b7-91e965bc59d7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.505968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.506916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.507562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.508098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.508950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.511099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.642122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 939/1876] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:31 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:31.646719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.672337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707ecd-0122-47e2-9e2a-587d1b4f3107 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.752501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.753350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.754023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.754023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.754867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.757502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.761968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:31.853636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 938/1877] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:31 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:31.856110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.867559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b931-20c1-4a30-87f1-b82f71d331a0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.876836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.878999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.879450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.879897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.881615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.883733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.897626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 940/1878] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:31.902119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.913368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b15b25-520c-453b-a7c0-ecdced2aa124 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:31.918314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:31.919211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:31.919503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:31.919923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] PATH_INFO: `/v3/projects/8fffcf04cc41432f92fd43b618c426d1/users/98bd6d6288344963a7c79229cb1543bd/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:31.937028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffcf04cc41432f92fd43b618c426d1, user_id=98bd6d6288344963a7c79229cb1543bd, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:31.939809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:31.983928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:31.985821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:31.999020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f378377-1555-43c6-81ab-b709f0d13178 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.004046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.005073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.005388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.005749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] PATH_INFO: `/v3/users/ffdb1c731915441c8c3daa32feaaf9ce` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.006977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdb1c731915441c8c3daa32feaaf9ce)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.011965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.081718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 939/1879] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:31 2022] PUT /identity/v3/projects/8fffcf04cc41432f92fd43b618c426d1/users/98bd6d6288344963a7c79229cb1543bd/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:32.086626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.150231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e098-1931-4323-be98-17872b9115fd admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.157839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.157839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.157839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.157839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.158208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.158594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.170837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 940/1880] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:32.175229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.185521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1560e1-8adb-4689-a0b5-54ffe1ed1671 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.190729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.191615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.191893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.192216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] PATH_INFO: `/v3/projects/8fffcf04cc41432f92fd43b618c426d1/users/98bd6d6288344963a7c79229cb1543bd/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.194789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffcf04cc41432f92fd43b618c426d1, user_id=98bd6d6288344963a7c79229cb1543bd, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.197416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484f37e-7e29-4c71-ba3f-8045625f9559 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.210299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 941/1881] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:32 2022] PUT /identity/v3/projects/8fffcf04cc41432f92fd43b618c426d1/users/98bd6d6288344963a7c79229cb1543bd/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:32.217761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdb1c731915441c8c3daa32feaaf9ce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.218757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdb1c731915441c8c3daa32feaaf9ce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.220706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.221001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.221279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.227519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdb1c731915441c8c3daa32feaaf9ce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.241042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdb1c731915441c8c3daa32feaaf9ce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.253602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] MFA Rules not processed for user `98bd6d6288344963a7c79229cb1543bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:32.255037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.292651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8d0d6419-7d17-4fa8-902f-fec854fdd755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdb1c731915441c8c3daa32feaaf9ce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.302680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 941/1882] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:31 2022] DELETE /identity/v3/users/ffdb1c731915441c8c3daa32feaaf9ce => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:32.304136 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.304429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.304715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.324114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:32.325791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.338636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 942/1883] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:32.346582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.348863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.412369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:32.420369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a844-3ce9-4712-b21d-4ae3aaddbd1d None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.423684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.425502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.489552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.490577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.491009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.491394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.530709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59631-042d-45e9-af12-4be7b6e0982d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.534960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.535619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.535902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.536179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.553417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.555377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.570522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 943/1885] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:32.587939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.591286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.605406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.605870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43473-abbb-44a2-8eca-bd001a1d4f8c service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.607658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.611269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.612377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.612936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.613364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] PATH_INFO: `/v3/users/c80199233fb640cfaab047b5c39f11d2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.614924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80199233fb640cfaab047b5c39f11d2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.617423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.621549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 943/1886] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:32.719861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:32.721507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.744216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba6d6b-1dbc-40c0-9c2e-afa76bc2e637 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:32.749382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:32.750394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.750682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.750961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] PATH_INFO: `/v3/users/6b8e059b2895407d80c0ee29542062f2` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.752226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8e059b2895407d80c0ee29542062f2)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:32.754328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:32.828656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80199233fb640cfaab047b5c39f11d2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.829759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80199233fb640cfaab047b5c39f11d2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.840365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80199233fb640cfaab047b5c39f11d2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.855648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80199233fb640cfaab047b5c39f11d2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.922265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-02b33600-3a20-4e91-acfa-0c4a2de2904e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80199233fb640cfaab047b5c39f11d2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:32.930757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 944/1887] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:32 2022] DELETE /identity/v3/users/c80199233fb640cfaab047b5c39f11d2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:32.935382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:32.935890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:32.936834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:32.959043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:32.960639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:32.984170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8e059b2895407d80c0ee29542062f2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.007273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8e059b2895407d80c0ee29542062f2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.008632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8e059b2895407d80c0ee29542062f2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.038467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 945/1888] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:33.043626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8e059b2895407d80c0ee29542062f2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.056755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:33.059969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:33.132590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1539a516-e784-43ff-9e21-673cda2a2f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8e059b2895407d80c0ee29542062f2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.144148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 944/1889] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:32 2022] DELETE /identity/v3/users/6b8e059b2895407d80c0ee29542062f2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:33.145861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:33.146161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:33.147622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:33.185292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691211ef-bdda-4782-ab04-115f9abfd896 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:33.185811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:33.187341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:33.219480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:33.270260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:33.270260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:33.270260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:33.270260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:33.272089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:33.290379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 945/1890] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:33.299815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:33.301426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:33.317103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf1ecf-413f-4621-8158-b2a486de6102 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:33.321182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:33.321945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:33.322295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:33.322700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:33.334562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:33.336019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:33.345973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 946/1891] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:33.348758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:33.351003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:33.362021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 946/1892] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:33.428369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:33.431218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:33.463924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888af5a-3ad0-4b84-a3d6-e803910dc2f3 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:33.471098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:33.488083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:33.488434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:33.488752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] PATH_INFO: `/v3/projects/ea3f6485cca2409899b45fbee095e98f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:33.492854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3f6485cca2409899b45fbee095e98f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:33.494951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:33.722916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3f6485cca2409899b45fbee095e98f', 'request_id': 'req-381177f9-1b53-4a4c-a890-f2ea9369f55b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.730981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3f6485cca2409899b45fbee095e98f', 'request_id': 'req-381177f9-1b53-4a4c-a890-f2ea9369f55b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.824552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3f6485cca2409899b45fbee095e98f', 'request_id': 'req-381177f9-1b53-4a4c-a890-f2ea9369f55b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.841282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] The token cache is being invalidate because project ea3f6485cca2409899b45fbee095e98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:33.841595 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.844319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:33.850063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 947/1893] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:33 2022] DELETE /identity/v3/projects/ea3f6485cca2409899b45fbee095e98f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:33.856693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:33.872711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de8fd-081a-4955-bad1-0dbddeb23bc8 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:33.875699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:33.961023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:33.961901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:33.962192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:33.962470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] PATH_INFO: `/v3/users/3a86342bc0b14fbf960225ecebddc121` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:33.963778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a86342bc0b14fbf960225ecebddc121)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:33.965804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:34.031345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:34.033819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:34.076037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381177f9-1b53-4a4c-a890-f2ea9369f55b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:34.081662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:34.082817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:34.083113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:34.083713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] PATH_INFO: `/v3/projects/d4577f467f1f4a69885e882bbfa7940b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:34.087046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4577f467f1f4a69885e882bbfa7940b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:34.088895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:34.192592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a86342bc0b14fbf960225ecebddc121'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.195012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a86342bc0b14fbf960225ecebddc121'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.217826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a86342bc0b14fbf960225ecebddc121'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.278416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a86342bc0b14fbf960225ecebddc121'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.284832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4577f467f1f4a69885e882bbfa7940b', 'request_id': 'req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.295350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4577f467f1f4a69885e882bbfa7940b', 'request_id': 'req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.372243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a86342bc0b14fbf960225ecebddc121'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.383573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 947/1894] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:33 2022] DELETE /identity/v3/users/3a86342bc0b14fbf960225ecebddc121 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:34.384942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:34.390196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:34.479812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abef68-5123-454e-8073-54c5a08cfb65 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:34.485002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:34.486372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:34.486662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:34.486985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] PATH_INFO: `/v3/projects/6d160bc0745a46e589eee39546d61f05` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:34.488495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d160bc0745a46e589eee39546d61f05)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:34.490739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:34.521341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4577f467f1f4a69885e882bbfa7940b', 'request_id': 'req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.542798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] The token cache is being invalidate because project d4577f467f1f4a69885e882bbfa7940b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:34.543208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.545052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.547373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 948/1895] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:34 2022] DELETE /identity/v3/projects/d4577f467f1f4a69885e882bbfa7940b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:34.551650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:34.553045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:34.622865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4940c1c-3ce6-4f66-9c66-a3c29d5b8695 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:34.629193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:34.630122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:34.630556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:34.631456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] PATH_INFO: `/v3/users/98bd6d6288344963a7c79229cb1543bd` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:34.633426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bd6d6288344963a7c79229cb1543bd)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:34.635333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:34.675544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d160bc0745a46e589eee39546d61f05', 'request_id': 'req-3979a6ba-350d-49f9-84bb-04b4d7d4df76'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.681500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d160bc0745a46e589eee39546d61f05', 'request_id': 'req-3979a6ba-350d-49f9-84bb-04b4d7d4df76'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.756226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d160bc0745a46e589eee39546d61f05', 'request_id': 'req-3979a6ba-350d-49f9-84bb-04b4d7d4df76'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.776280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] The token cache is being invalidate because project 6d160bc0745a46e589eee39546d61f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:34.776839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.777828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.779736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 948/1896] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:34 2022] DELETE /identity/v3/projects/6d160bc0745a46e589eee39546d61f05 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:34.784215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:34.785978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:34.855431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979a6ba-350d-49f9-84bb-04b4d7d4df76 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:34.862998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:34.864017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:34.870306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:34.870306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] PATH_INFO: `/v3/users/29d20f18cd614f9d80a07f47af0418d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:34.870306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d20f18cd614f9d80a07f47af0418d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:34.870306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:34.875816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bd6d6288344963a7c79229cb1543bd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.884071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bd6d6288344963a7c79229cb1543bd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.884814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bd6d6288344963a7c79229cb1543bd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:34.899186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bd6d6288344963a7c79229cb1543bd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.024231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bd6d6288344963a7c79229cb1543bd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.031441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 949/1897] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:34 2022] DELETE /identity/v3/users/98bd6d6288344963a7c79229cb1543bd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:35.036647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:35.036647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:35.108450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8a59-3f27-45b6-a430-a9c9ad00042e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:35.114511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:35.119431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.120033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.124740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] PATH_INFO: `/v3/projects/a87b0daed39441038dd2a4c71994fbb8` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.124740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87b0daed39441038dd2a4c71994fbb8)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:35.124934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:35.137461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d20f18cd614f9d80a07f47af0418d3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.139157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d20f18cd614f9d80a07f47af0418d3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.151251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d20f18cd614f9d80a07f47af0418d3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.167798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d20f18cd614f9d80a07f47af0418d3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.230476 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87b0daed39441038dd2a4c71994fbb8', 'request_id': 'req-3c449578-4dce-40f9-bee9-b8d71b2397a4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.235124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b5d2e5a-6fd6-477e-b799-886de54ee5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d20f18cd614f9d80a07f47af0418d3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.237392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87b0daed39441038dd2a4c71994fbb8', 'request_id': 'req-3c449578-4dce-40f9-bee9-b8d71b2397a4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.243890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 949/1898] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:34 2022] DELETE /identity/v3/users/29d20f18cd614f9d80a07f47af0418d3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:35.335025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87b0daed39441038dd2a4c71994fbb8', 'request_id': 'req-3c449578-4dce-40f9-bee9-b8d71b2397a4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.349752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] The token cache is being invalidate because project a87b0daed39441038dd2a4c71994fbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:35.350128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.350871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-3c449578-4dce-40f9-bee9-b8d71b2397a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:35.353172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 950/1899] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:35 2022] DELETE /identity/v3/projects/a87b0daed39441038dd2a4c71994fbb8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:35.358264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.358552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.358833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.367766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:35.379451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:35.380696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:35.437596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:35.483062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 950/1900] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:35.490916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.491210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.491531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.532701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:35.534313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:35.550015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 951/1901] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:35.556400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:35.566543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eee9bb-9621-4913-9b49-98816b86d3ab None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:35.579098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:35.579974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.580260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.580538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.581533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:35.586707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:35.589671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:35.621258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 951/1902] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:35.621614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:35.638328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10db8d2-bb65-4986-a8cc-2bb3cd274a6b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:35.647723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:35.648726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.649133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.649502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.650344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:35.652431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:35.761692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 952/1903] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:35 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:35.764568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:35.777249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16dc9e-6dd8-4094-8bcc-18e02b02d5eb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:35.796869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:35.798864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:35.885316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:35.886456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.886814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.887159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.888723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:35.891869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:35.948986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608f28-630a-4d2e-bce8-2d317f6e5a5a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:35.957062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:35.958128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:35.959826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:35.959826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] PATH_INFO: `/v3/projects/d0afd0710981483488bdcbd3220e7e26` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:35.961158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0afd0710981483488bdcbd3220e7e26)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:35.963247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.001134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 952/1904] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:35 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:36.004848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.020150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722fed-779c-40a6-b5d0-6b7523b43ec6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.026013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.027434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.027859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.028362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.029258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.031101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.042465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 953/1905] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:36.046628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.057298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a214ef-7d30-4d56-b7cd-1f1d71071c79 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.063406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.064106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.064394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.064710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.065478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.067356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.080643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 954/1906] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:36.090213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.112949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff223fc-856d-4152-a6ea-e9fbee726f4a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.113046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0afd0710981483488bdcbd3220e7e26', 'request_id': 'req-5d79ff42-957b-4062-8f1b-a184836f6576'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.122156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0afd0710981483488bdcbd3220e7e26', 'request_id': 'req-5d79ff42-957b-4062-8f1b-a184836f6576'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.207884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0afd0710981483488bdcbd3220e7e26', 'request_id': 'req-5d79ff42-957b-4062-8f1b-a184836f6576'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.208128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.209796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.210117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.210547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] PATH_INFO: `/v3/projects/054d1c4cf7e744cea06d85d78991658f/users/28b0be41308c4d87aa4488b45feb837d/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.226916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] The token cache is being invalidate because project d0afd0710981483488bdcbd3220e7e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:36.228113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.228872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.233698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 953/1907] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:35 2022] DELETE /identity/v3/projects/d0afd0710981483488bdcbd3220e7e26 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:36.233698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.238190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.238283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054d1c4cf7e744cea06d85d78991658f, user_id=28b0be41308c4d87aa4488b45feb837d, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.240315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f2357-7d42-4472-84f9-8baea6d26bc1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.252740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ff42-957b-4062-8f1b-a184836f6576 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.259768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.261297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.261814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.262282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] PATH_INFO: `/v3/projects/8fffcf04cc41432f92fd43b618c426d1` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.266871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fffcf04cc41432f92fd43b618c426d1)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.267806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.305528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 955/1908] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:36 2022] PUT /identity/v3/projects/054d1c4cf7e744cea06d85d78991658f/users/28b0be41308c4d87aa4488b45feb837d/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:36.309337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77253-d92b-4a06-831a-5c6cb0d9a2b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.309670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77253-d92b-4a06-831a-5c6cb0d9a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.309930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77253-d92b-4a06-831a-5c6cb0d9a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.328490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4df77253-d92b-4a06-831a-5c6cb0d9a2b3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:36.330060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4df77253-d92b-4a06-831a-5c6cb0d9a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.381807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fffcf04cc41432f92fd43b618c426d1', 'request_id': 'req-bc3afdaf-936a-4725-be13-19443906cbaa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.391078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fffcf04cc41432f92fd43b618c426d1', 'request_id': 'req-bc3afdaf-936a-4725-be13-19443906cbaa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.403215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 956/1909] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:36.404518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73a73-bad0-452e-af19-2eda4014813b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.404912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73a73-bad0-452e-af19-2eda4014813b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.405298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73a73-bad0-452e-af19-2eda4014813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.434202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ebe73a73-bad0-452e-af19-2eda4014813b None None] MFA Rules not processed for user `28b0be41308c4d87aa4488b45feb837d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:36.435400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ebe73a73-bad0-452e-af19-2eda4014813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.482199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fffcf04cc41432f92fd43b618c426d1', 'request_id': 'req-bc3afdaf-936a-4725-be13-19443906cbaa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.499023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] The token cache is being invalidate because project 8fffcf04cc41432f92fd43b618c426d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:36.499367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.502640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc3afdaf-936a-4725-be13-19443906cbaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:36.504624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 954/1910] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:36 2022] DELETE /identity/v3/projects/8fffcf04cc41432f92fd43b618c426d1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:36.506439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.506853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.507694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.528180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:36.528979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.583624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 957/1911] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:36.587859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.589219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.590001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.650917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:36.651561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.720608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 955/1912] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:36.721857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.724219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.750174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e0f11-61ac-4034-aca2-8a7870ce29f8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.758307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.758985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.759639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.760067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.760783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.764677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.781477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 958/1913] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:36.786869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.812938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916e68-e851-451b-be1c-9cfb3789ee3d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.826410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.827071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.827412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.827750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.828652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:36.835716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.837921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7333ab-5b24-497f-bf08-3abdc1933a4a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.853007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:36.867045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 959/1914] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:36.868758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.869047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.869326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.889881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:36.891190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:36.900524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 960/1915] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:36.901322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.912796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fe2fe-a7c8-42fd-bfe4-afa4ad2bde5f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:36.917642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:36.918324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:36.918606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:36.918894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:36.919617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:36.921874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:36.975291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 956/1916] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:36.976208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:36.999827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.028695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 961/1917] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:36 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:37.028695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.067488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb384-4b46-45d6-a14b-a89aebd243a8 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.122137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be6c4d-21ae-4e2d-b08a-0c4d0706f519 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.128731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.129904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.130352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.131705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.132679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.136227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.156949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.157945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.158923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.158923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.161028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:37.161557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.164433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.180192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 957/1918] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:37.180192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.191375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c5e-183e-412c-b1a3-3aca0709716e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.197965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.198936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.199259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.200279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.201016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.203091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.238877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 962/1919] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:37 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:37.238877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.247762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50255-8df1-4314-b254-333aa64d41a6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.253617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.254493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.255008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.255189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.257642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.258534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.345670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 958/1920] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:37 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:37.346642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.358055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bad37-8e8f-4294-9efb-5fc0a73e4a12 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.363834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.364490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.364788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.365843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.367140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.369024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.382916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 959/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:37.383944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.386788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 963/1922] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:37 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:37.387899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.397562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f891-d843-46b1-8ca3-b17d3ce65094 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.461794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df915e-ba75-4505-bd76-1aba71db4a2f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.470798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.471519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.471806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.472443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.476674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.479805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.493095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 960/1923] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:37.493826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.498620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.503331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.503331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.503331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] PATH_INFO: `/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5/users/1301de49ea154973a5ba88316a439437/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.509162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1841-966b-455d-a088-870b1ec52347 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.517179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.523258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.523258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.523258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.523258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.523258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.529998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d99e2d870a544f0a9014b9347f3c4e5, user_id=1301de49ea154973a5ba88316a439437, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.532775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.607175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.659327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 961/1924] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:37 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:37.660418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.663731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 964/1925] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:37 2022] PUT /identity/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5/users/1301de49ea154973a5ba88316a439437/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:37.664733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.670202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.676772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcc56-ac78-4e87-a7c7-d91c8f4672a2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.760485 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.761518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.761939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.762640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.763169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.765214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.778575 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 962/1926] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:37.779702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.784704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d614-2b3c-4388-bd53-ede471a1c75a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.792355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d99f9-1e0a-46a6-8697-bf50d7872ffc admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.797919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.798740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.799190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.799608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.800550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.802568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.804968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.806070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.806359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.806632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.813324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.813324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.820553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 963/1927] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:37.825374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 965/1928] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:37.826336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.831075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.839865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b1708-7450-48b1-b215-8ee3e43fc46c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.850814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.852028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38ff7-be26-42d1-aa48-b8c09358797e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.854687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.855690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.855999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] PATH_INFO: `/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5/users/1301de49ea154973a5ba88316a439437/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.857627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.859268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.859734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.860097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] PATH_INFO: `/v3/projects/587b72b956e54c0da401411cba200a36/users/c2043ba7d682484ab4dcb4f26b9b005c/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.860635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d99e2d870a544f0a9014b9347f3c4e5, user_id=1301de49ea154973a5ba88316a439437, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.865308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.879481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=587b72b956e54c0da401411cba200a36, user_id=c2043ba7d682484ab4dcb4f26b9b005c, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.879853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 966/1929] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:37 2022] PUT /identity/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5/users/1301de49ea154973a5ba88316a439437/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:37.883082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:37.894459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:37.910936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.984050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed80b9-1bda-4af5-a9fb-69d66cfcd464 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:37.990015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:37.991105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:37.991395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:37.991824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:37.993503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:37.994762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd61d4-3746-4482-9210-893c6fe78dc2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.006917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 967/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:38.008401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72d1a-7c01-47c4-a3c1-913850b24f9f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.008587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72d1a-7c01-47c4-a3c1-913850b24f9f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.008827 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72d1a-7c01-47c4-a3c1-913850b24f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.028521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 964/1931] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:37 2022] PUT /identity/v3/projects/587b72b956e54c0da401411cba200a36/users/c2043ba7d682484ab4dcb4f26b9b005c/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:38.028521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.043360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-14b72d1a-7c01-47c4-a3c1-913850b24f9f None None] MFA Rules not processed for user `1301de49ea154973a5ba88316a439437`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:38.045092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14b72d1a-7c01-47c4-a3c1-913850b24f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.127930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcfd33-fdd3-45d0-99eb-b2c6f7916a2c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.136301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.137422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.141948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.142084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 968/1932] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:38.142167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] PATH_INFO: `/v3/projects/45f1f169bb3a45158ce6f75fddb567d9/users/72dc356f7a9d421786639eb8cb573377/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.142239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d9f-3a64-4a66-8c3a-4a1802cb06f4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.142239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d9f-3a64-4a66-8c3a-4a1802cb06f4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.142239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d9f-3a64-4a66-8c3a-4a1802cb06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.160238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f1f169bb3a45158ce6f75fddb567d9, user_id=72dc356f7a9d421786639eb8cb573377, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.164149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.180524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d2a29d9f-3a64-4a66-8c3a-4a1802cb06f4 None None] MFA Rules not processed for user `c2043ba7d682484ab4dcb4f26b9b005c`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:38.182668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d2a29d9f-3a64-4a66-8c3a-4a1802cb06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.242359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 965/1933] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:38 2022] PUT /identity/v3/projects/45f1f169bb3a45158ce6f75fddb567d9/users/72dc356f7a9d421786639eb8cb573377/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:38.243648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.245265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.269142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 969/1934] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:38.271120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.272696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.273454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.334996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] MFA Rules not processed for user `72dc356f7a9d421786639eb8cb573377`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:38.336551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.343308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b6a7-486b-405e-8cba-e3011e12b6b5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.348506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.350039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.350789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.350789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.401992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:38.446803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 970/1935] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:38.449357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.451842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.467039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:38.468171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.468273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627011d-80e7-4a7e-8462-29758efbdcf2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.468858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.471651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.472319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.472597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.472864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.481175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 966/1936] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:38.482265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.483735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:38.551759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.554298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.565500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 971/1937] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:38.579629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0737-9acf-4020-b9d9-ed908afd8c88 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.583130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.585913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.587531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.587531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.587531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.608582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.610499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.624527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 967/1938] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:38.690587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:38.713007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4884f0-214f-43ca-88c5-9c40e5cf1e99 service glance] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.722984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986e59-50ab-478d-82a1-934280994654 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:38.732541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.733209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.733493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.733792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.744799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:38.747381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:38.747665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:38.752622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] PATH_INFO: `/v3/users/c2043ba7d682484ab4dcb4f26b9b005c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:38.753757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2043ba7d682484ab4dcb4f26b9b005c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.763476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.859284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:38.861677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4f80d-b65d-4113-bae9-705239d1c605 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:38.879992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 968/1939] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:39.069727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2043ba7d682484ab4dcb4f26b9b005c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.070518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2043ba7d682484ab4dcb4f26b9b005c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.079807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2043ba7d682484ab4dcb4f26b9b005c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.095907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2043ba7d682484ab4dcb4f26b9b005c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.203311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2043ba7d682484ab4dcb4f26b9b005c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.213016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 972/1940] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:38 2022] DELETE /identity/v3/users/c2043ba7d682484ab4dcb4f26b9b005c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:39.217976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:39.218495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:39.219153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:39.232513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:39.259783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:39.261515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:39.368125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 969/1941] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:39.377917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:39.379482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:39.508995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f28c-253d-4cdf-813a-45db5a81b7f7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:39.514389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:39.515176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:39.515575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:39.515960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:39.529239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:39.530963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648f00-2ca5-461a-9c29-b9dcf429ef11 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:39.547036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 973/1942] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:16:39.639520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:39.640822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:39.663982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fc31c-bc44-4e84-a15a-e3117e4f3db3 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:39.679698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:39.680513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:39.680800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:39.681082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] PATH_INFO: `/v3/users/28b0be41308c4d87aa4488b45feb837d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:39.682325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b0be41308c4d87aa4488b45feb837d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:39.684496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:39.824496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:39.984302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b0be41308c4d87aa4488b45feb837d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:39.998983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b0be41308c4d87aa4488b45feb837d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:40.000072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b0be41308c4d87aa4488b45feb837d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:40.018202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b0be41308c4d87aa4488b45feb837d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:40.115472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b0be41308c4d87aa4488b45feb837d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:40.124251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 970/1943] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:39 2022] DELETE /identity/v3/users/28b0be41308c4d87aa4488b45feb837d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:40.128503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:40.129109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:40.129109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:40.153489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:40.156086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:40.227981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 974/1944] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:40.244981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:40.244981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:40.317248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f3b80-a7e0-409d-bdec-1c1c61320198 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:40.322670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:40.323345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:40.323632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:40.323912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:40.334887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:40.336372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:40.354067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 971/1945] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:40.701630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:40.704797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:40.786004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed1dd-7e1e-4099-aafd-87656e2c1504 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:40.786004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:40.786004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:40.786004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:40.787910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] PATH_INFO: `/v3/projects/587b72b956e54c0da401411cba200a36` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:40.787910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587b72b956e54c0da401411cba200a36)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:40.787910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:40.841712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:41.002000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587b72b956e54c0da401411cba200a36', 'request_id': 'req-c6b49145-d399-43c4-bb68-2861cee5f972'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.011730 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587b72b956e54c0da401411cba200a36', 'request_id': 'req-c6b49145-d399-43c4-bb68-2861cee5f972'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.041499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.044319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:41.061885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce615c-990f-49e9-bc6f-2415234b715e service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.117841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:41.149880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587b72b956e54c0da401411cba200a36', 'request_id': 'req-c6b49145-d399-43c4-bb68-2861cee5f972'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.169357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.171018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.171312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.171640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] PATH_INFO: `/v3/projects/054d1c4cf7e744cea06d85d78991658f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.173195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] RBAC: Authorizing `identity:delete_project(project_id=054d1c4cf7e744cea06d85d78991658f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.174777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] The token cache is being invalidate because project 587b72b956e54c0da401411cba200a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:41.175221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.175500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.176132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6b49145-d399-43c4-bb68-2861cee5f972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.184026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 975/1946] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:40 2022] DELETE /identity/v3/projects/587b72b956e54c0da401411cba200a36 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:41.188763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c24ae-11b3-4210-be39-4beea7dedd96 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.191211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c24ae-11b3-4210-be39-4beea7dedd96 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.191211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c24ae-11b3-4210-be39-4beea7dedd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.227724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b36c24ae-11b3-4210-be39-4beea7dedd96 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:41.231471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b36c24ae-11b3-4210-be39-4beea7dedd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:41.248899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 976/1947] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:41.252488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.253123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.253501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.303475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:41.304974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:41.323161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 977/1948] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:16:41.325171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.339652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae22229-52dc-4825-8236-98341bd7009d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.367774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.368574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.368803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.369186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.371222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:41.371222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.372055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.391541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054d1c4cf7e744cea06d85d78991658f', 'request_id': 'req-dd13bdb3-5a79-40be-8c9b-22c18c29951b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.412979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054d1c4cf7e744cea06d85d78991658f', 'request_id': 'req-dd13bdb3-5a79-40be-8c9b-22c18c29951b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.413156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 978/1949] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:41.417864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.429226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d7bf-73c1-4493-ad07-6180bb4b5621 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.493407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054d1c4cf7e744cea06d85d78991658f', 'request_id': 'req-dd13bdb3-5a79-40be-8c9b-22c18c29951b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.516374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] The token cache is being invalidate because project 054d1c4cf7e744cea06d85d78991658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:41.516675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.517492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.520775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 972/1950] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:41 2022] DELETE /identity/v3/projects/054d1c4cf7e744cea06d85d78991658f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:41.526177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.527811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:41.533204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.536552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.536552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.536552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.536552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.538172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.572912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13bdb3-5a79-40be-8c9b-22c18c29951b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.578563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.579612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.580088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.580426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] PATH_INFO: `/v3/users/1301de49ea154973a5ba88316a439437` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.588985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1301de49ea154973a5ba88316a439437)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.593267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.653398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 979/1951] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:41 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:41.657746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.659435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:41.747717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf152-7bfb-4a53-a071-7b2724eb25cf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.752892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.753616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.753898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.754172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.755033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.757325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.804215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1301de49ea154973a5ba88316a439437'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.823924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1301de49ea154973a5ba88316a439437'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.826839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1301de49ea154973a5ba88316a439437'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.859353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1301de49ea154973a5ba88316a439437'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.862165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 980/1952] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:41 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:41.867840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.884546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48ce41-6a32-42e6-a348-0904745f81db admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.887619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.888309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.888597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.888867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.889619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.893341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.913067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 981/1953] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:41.915574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.926179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71eaf-bc31-44ce-aae3-9225d6c69ddf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.931817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.932510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.932800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.933259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.934106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:41.935721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:41.951680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 982/1954] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:41.952847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:41.964482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1fd7b-8e1a-4b27-9698-340329c6db2b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:41.972778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5a68f520-a97e-40a6-9a65-fb642810f874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1301de49ea154973a5ba88316a439437'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:41.973379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:41.974513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:41.975285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:41.975744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] PATH_INFO: `/v3/projects/1926f35c2b8c4913b0baf766b7b64930/users/0577e29f9a5d4501b7885166b1673250/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:41.984958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 973/1955] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:41 2022] DELETE /identity/v3/users/1301de49ea154973a5ba88316a439437 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:41.998206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1926f35c2b8c4913b0baf766b7b64930, user_id=0577e29f9a5d4501b7885166b1673250, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:42.001701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:42.088435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 983/1956] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:41 2022] PUT /identity/v3/projects/1926f35c2b8c4913b0baf766b7b64930/users/0577e29f9a5d4501b7885166b1673250/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:42.102416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:42.105710 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:42.106552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:42.174027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] MFA Rules not processed for user `0577e29f9a5d4501b7885166b1673250`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:42.175901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:42.267693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 974/1957] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:42.285499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:42.292100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:42.392710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac829b-9d70-41b0-a328-a9cc48a2d5a0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:42.398755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:42.407018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:42.407018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:42.407018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:42.410585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:42.412919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ce12-bae1-4e58-bf3e-45b509219296 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:42.425008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 984/1958] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:42.682835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:42.687400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:42.706322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.749916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.792659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118963-5044-4c7b-8a10-521b3b406262 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:42.797990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:42.798886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:42.799176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:42.799494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] PATH_INFO: `/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:42.800853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d99e2d870a544f0a9014b9347f3c4e5)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:42.802917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:42.940276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d99e2d870a544f0a9014b9347f3c4e5', 'request_id': 'req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:42.948981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d99e2d870a544f0a9014b9347f3c4e5', 'request_id': 'req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:43.055334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d99e2d870a544f0a9014b9347f3c4e5', 'request_id': 'req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:43.073875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] The token cache is being invalidate because project 0d99e2d870a544f0a9014b9347f3c4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:43.074171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:43.074852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-447b46c9-27ba-42d0-84fc-7c2fb2efff6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:43.076609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 975/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:42 2022] DELETE /identity/v3/projects/0d99e2d870a544f0a9014b9347f3c4e5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:43.081912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.082506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.082864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.106703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:43.107923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:43.210227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 985/1960] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:43.214123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.214619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.215563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.256482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:43.259758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:43.285757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 976/1961] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:43.286538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.304296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0dc8-d539-4738-80f5-e5bfa2c76382 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.321675 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.322363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.322642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.322948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.323636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:43.323939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.325598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.347977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 986/1962] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:43.355401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.378367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8077-1443-431e-8413-24c08f5c93a8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.381110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.381929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.382217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.382592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.383282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.385272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.477559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 977/1963] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:43 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:43.482171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.493534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2bd2-0f02-45c4-b1da-881633dc1f6f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.564230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.565531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.565969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.566361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.567134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.569992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.676059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.676716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 987/1964] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:43 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:43.689005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e289-6c9a-4eaf-b553-0699f5a98254 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.699100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.699800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.700093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.700375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.701125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.702759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.721920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 978/1965] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:43.723516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.736767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ab25-39ba-45e8-8947-231543304816 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.742684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.743635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.743989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.744336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.745140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.746915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1f325-7f0c-476c-b596-62436daea3ff admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.765505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 988/1966] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:43.771006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:43.786827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fa81-be52-4e76-ae5f-8c8a580f9b2c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:43.793731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:43.799921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.799921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.799921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] PATH_INFO: `/v3/projects/b55d1220c0334576836ad4347d1f7a37/users/50dfbfb9084e432980acb767860741cc/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:43.816778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55d1220c0334576836ad4347d1f7a37, user_id=50dfbfb9084e432980acb767860741cc, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:43.830481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:43.984749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 979/1967] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:43 2022] PUT /identity/v3/projects/b55d1220c0334576836ad4347d1f7a37/users/50dfbfb9084e432980acb767860741cc/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:43.996380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:43.996751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:43.997189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:44.027414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] MFA Rules not processed for user `50dfbfb9084e432980acb767860741cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:44.028756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:44.095171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:44.104785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 989/1968] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:44.117469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:44.119619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:44.174182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:44.183130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6536b-0c05-49d9-8e98-009c462d2b1c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:44.186982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:44.187640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:44.187927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:44.188209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:44.196914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:44.198404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb9654-aa6f-4293-9002-aed2cc0747b7 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:44.207362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 980/1969] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:45.093057 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:45.613090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.054064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.533250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.681161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.788524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:47.087153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:47.493426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:47.584715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:47.778979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:47.972986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:48.315549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:48.459084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:48.727592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:51.638178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:51.704745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555834cb-7a35-480a-9b3f-8092e5959fbb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:51.710684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:51.711640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:51.711920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:51.712199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] PATH_INFO: `/v3/users/50dfbfb9084e432980acb767860741cc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:51.713423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50dfbfb9084e432980acb767860741cc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:51.715711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:51.953596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50dfbfb9084e432980acb767860741cc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:51.954311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50dfbfb9084e432980acb767860741cc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:51.963486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50dfbfb9084e432980acb767860741cc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:51.976552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50dfbfb9084e432980acb767860741cc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:52.109696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50dfbfb9084e432980acb767860741cc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:52.121138 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 990/1970] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:51 2022] DELETE /identity/v3/users/50dfbfb9084e432980acb767860741cc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:52.122858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:52.123336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:52.123523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:52.153960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:52.155207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:52.236282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 981/1971] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:52.247074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:52.249799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:52.330645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf50d-a55f-48a4-bc36-8d15f635124f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:52.338544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:52.339350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:52.339720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:52.340002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:52.352324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:52.353942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d380c-e236-4b57-88cc-60ee0b0c1ec1 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:52.358224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:52.364760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 991/1972] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:52.862500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:52.864385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:52.886168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe2d9-fcea-49af-aa70-04132b53e22f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:52.892045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:52.893367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:52.893857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:52.897309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] PATH_INFO: `/v3/projects/b55d1220c0334576836ad4347d1f7a37` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:52.898477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55d1220c0334576836ad4347d1f7a37)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:52.901263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.089218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55d1220c0334576836ad4347d1f7a37', 'request_id': 'req-65c6f466-9dc2-499e-ba8b-5a221e05f852'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:53.095766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55d1220c0334576836ad4347d1f7a37', 'request_id': 'req-65c6f466-9dc2-499e-ba8b-5a221e05f852'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:53.190538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55d1220c0334576836ad4347d1f7a37', 'request_id': 'req-65c6f466-9dc2-499e-ba8b-5a221e05f852'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:53.202225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] The token cache is being invalidate because project b55d1220c0334576836ad4347d1f7a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:53.202522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:53.203191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-65c6f466-9dc2-499e-ba8b-5a221e05f852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:53.204720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 982/1973] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:52 2022] DELETE /identity/v3/projects/b55d1220c0334576836ad4347d1f7a37 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:53.210157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.213464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.213464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.230859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:53.232313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:53.324100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 992/1974] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:53.333770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.334068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.334372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.360871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:53.362254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:53.371989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 983/1975] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:53.376384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.389144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40374eeb-abd4-43e4-a64d-5ce716bff993 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.398347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.399052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.400400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.400400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.400400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:53.400791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.403112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.417616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 993/1976] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:16:53.421313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.432702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842cc61-6972-41cf-99c1-0875eb53f740 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.437985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.438662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.438947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.439544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.440286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.442328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.549725 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 984/1977] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:53 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:53.554557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.565056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372c3a-eb91-40f9-960b-822cb87e7c87 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.624894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.625597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.625895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.626180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.626874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.628891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.723056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 994/1978] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:53 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:53.727676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.739483 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba322d98-157c-4828-a26f-0585c5c37c2c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.744834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.745545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.745859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.746935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.747739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.749671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.761661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 985/1979] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:53.765732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.776541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ce349-a60c-4b31-88bf-2109e7e84fab admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.781557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.782264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.783496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.783496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.783698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.785237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8bef-08d1-4ebb-9a25-ade80e2baa5a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.796683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 995/1980] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:53.801160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:53.813044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537a77-48ec-4ae4-8f81-d0ce6c9e979e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:53.818638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:53.819666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.819977 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.820261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] PATH_INFO: `/v3/projects/2e1404cce0424c9aa3e1b3b576d3bb39/users/213dda3b48cc49a5bb8ceaa4ece28e7d/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.836282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1404cce0424c9aa3e1b3b576d3bb39, user_id=213dda3b48cc49a5bb8ceaa4ece28e7d, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:53.839096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:53.939145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 986/1981] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:53 2022] PUT /identity/v3/projects/2e1404cce0424c9aa3e1b3b576d3bb39/users/213dda3b48cc49a5bb8ceaa4ece28e7d/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:53.950542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:53.950881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:53.951145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:53.979483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] MFA Rules not processed for user `213dda3b48cc49a5bb8ceaa4ece28e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:53.980630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:54.041148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:54.052233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 996/1982] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:54.063526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:54.065306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:54.080214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:54.136347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0a346-aea5-4971-a004-24e2b321eca1 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:54.140878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:54.141554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:54.143441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:54.143441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:54.153617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:54.155212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3a39-3811-4636-94f9-65c78773c796 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:54.165433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 987/1983] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:59.464062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:59.537638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06785d-da86-43ef-b8a2-08a94dd6d1bb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:59.542616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:59.543242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:59.543519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:59.543800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] PATH_INFO: `/v3/users/213dda3b48cc49a5bb8ceaa4ece28e7d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:59.545055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=213dda3b48cc49a5bb8ceaa4ece28e7d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:59.547032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:59.766209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213dda3b48cc49a5bb8ceaa4ece28e7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:59.766871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213dda3b48cc49a5bb8ceaa4ece28e7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:59.775350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213dda3b48cc49a5bb8ceaa4ece28e7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:59.788704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213dda3b48cc49a5bb8ceaa4ece28e7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:59.859211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213dda3b48cc49a5bb8ceaa4ece28e7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:59.868101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 997/1984] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:59 2022] DELETE /identity/v3/users/213dda3b48cc49a5bb8ceaa4ece28e7d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:59.873767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:59.874239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:59.874499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:59.899363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:59.900618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:59.971238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 988/1985] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:59.981886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:59.983441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:00.060503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b246c4-1e3f-4f46-9102-9aef1b78b23d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:00.065613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:00.069148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:00.069148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:00.069148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:00.080061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:00.081742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39558baf-03a2-4ede-aa3e-c28e866c4619 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:00.092364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 998/1986] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:00.650677 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:00.653235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:00.680867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff00c2-8a52-45f3-8a9d-cbf89334c760 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:00.686836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:00.687730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:00.688016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:00.688308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] PATH_INFO: `/v3/projects/2e1404cce0424c9aa3e1b3b576d3bb39` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:00.689818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1404cce0424c9aa3e1b3b576d3bb39)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:00.691758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:00.847453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1404cce0424c9aa3e1b3b576d3bb39', 'request_id': 'req-100e0231-f7c4-43c9-8875-4ee5edf67fda'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:00.856873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1404cce0424c9aa3e1b3b576d3bb39', 'request_id': 'req-100e0231-f7c4-43c9-8875-4ee5edf67fda'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:00.950135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1404cce0424c9aa3e1b3b576d3bb39', 'request_id': 'req-100e0231-f7c4-43c9-8875-4ee5edf67fda'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:00.964628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] The token cache is being invalidate because project 2e1404cce0424c9aa3e1b3b576d3bb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:00.964931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:00.965700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-100e0231-f7c4-43c9-8875-4ee5edf67fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:00.970607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 989/1987] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:00 2022] DELETE /identity/v3/projects/2e1404cce0424c9aa3e1b3b576d3bb39 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:00.972267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:00.972717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:00.972850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:00.992571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:00.993844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.005014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:01.056754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 999/1988] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:01.064943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.065234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.065518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.085304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:01.086530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.094558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 990/1989] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:01.098898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.116037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cf35-427c-4519-8596-4dba5a04b193 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.116037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.116037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.116037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.116574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.116800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:01.117243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.118764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97139b5-2b3d-4406-ab4a-485c6835bf94 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.135370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1000/1990] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:01.136788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.146280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18582d9a-8eae-4ce9-9955-70f3bd098047 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.151728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.152552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.152838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.153118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.153853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.155773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.164910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecafe8-ae0f-4543-a85f-e30b1fdbea16 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.165767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecafe8-ae0f-4543-a85f-e30b1fdbea16 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.166120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecafe8-ae0f-4543-a85f-e30b1fdbea16 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.168262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1001/1991] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:17:01.188619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.188619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.188619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.202493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] MFA Rules not processed for user `06e6c97215674774b1bbb18cfde54df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:01.203715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.243685 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 991/1992] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:01.248190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.258784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:01.270610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1002/1993] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:01.283148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.284577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.298628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4983-8899-4c2a-9e64-5322e367ac51 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.321284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbfd9-33f8-47ad-9373-3fd1f0fa52fe admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.326523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.327199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.327480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.327752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.328437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.330391 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.366440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.367095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.367373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.367647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.376678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.378545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.389297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1003/1994] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:01.390226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.391633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.406007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a985-9951-420c-a5d5-1770733dcf42 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.411107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.412024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.412464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.413183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] PATH_INFO: `/v3/users/aed9843697634f8792ac0ec21a16288e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.414570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed9843697634f8792ac0ec21a16288e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.416496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.430162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 992/1995] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:01.431201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.442249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68979e7-b941-40e6-bd1b-66e6f288ef1f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.446725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:01.448306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.448985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.449270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.449550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.450342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.457618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.464346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 993/1996] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:01.468519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.479651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc184ea-ae03-45f6-97a3-40625ad9ff95 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.485569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.486294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.486646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.486928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.487662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.489261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.501148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 994/1997] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:01.505424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.516536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94fe0-c123-4820-9d0a-7c53e537fff9 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.521235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.522957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.523259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.523666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] PATH_INFO: `/v3/projects/cd8984c412094d299c7ccd993afb77ab/users/31c430ee345c4303b6485e43177ba293/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.538988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8984c412094d299c7ccd993afb77ab, user_id=31c430ee345c4303b6485e43177ba293, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.541765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692272ee-1e2e-4737-89fd-df491029fb16 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.591179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 995/1998] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:01 2022] PUT /identity/v3/projects/cd8984c412094d299c7ccd993afb77ab/users/31c430ee345c4303b6485e43177ba293/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:01.601771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed9843697634f8792ac0ec21a16288e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:01.602392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed9843697634f8792ac0ec21a16288e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:01.607047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.607344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.607629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.610249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed9843697634f8792ac0ec21a16288e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:01.623351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed9843697634f8792ac0ec21a16288e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:01.636151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] MFA Rules not processed for user `31c430ee345c4303b6485e43177ba293`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:01.637410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.693002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed9843697634f8792ac0ec21a16288e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:01.700746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1004/1999] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:01 2022] DELETE /identity/v3/users/aed9843697634f8792ac0ec21a16288e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:01.701561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 996/2000] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:01.706126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.707997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.786139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd527cc-a76e-479e-86da-b8aae5e23f7c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:01.791214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:01.791900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:01.792189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:01.792469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:01.793798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:01.795555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:01.945278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.946753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:01.981086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1005/2001] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:01.985963 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:01.998617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:02.038396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79d0fd-eb77-4cd1-a48d-404abcb3e7fe None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.069751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c134cd-930b-4055-ad3c-c2ec5fe15081 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.074807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.075486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.075775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.076052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.076740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.078714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.099711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.101717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.101717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.101988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] PATH_INFO: `/v3/users/0577e29f9a5d4501b7885166b1673250` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.102944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0577e29f9a5d4501b7885166b1673250)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.104862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.144791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1006/2002] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:01 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:02.145689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.147808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.160269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050850f-04e9-4daa-9a9c-a1fd976bd8a2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.165565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.167471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.167471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.167471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] PATH_INFO: `/v3/projects/ec0ecebd089a4e479f6909fed9101d0e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.168343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0ecebd089a4e479f6909fed9101d0e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.170332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.184199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:02.324774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0577e29f9a5d4501b7885166b1673250'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.326166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0ecebd089a4e479f6909fed9101d0e', 'request_id': 'req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.332246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0ecebd089a4e479f6909fed9101d0e', 'request_id': 'req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.332446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0577e29f9a5d4501b7885166b1673250'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.333156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0577e29f9a5d4501b7885166b1673250'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.346618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0577e29f9a5d4501b7885166b1673250'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.429844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0ecebd089a4e479f6909fed9101d0e', 'request_id': 'req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.442285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] The token cache is being invalidate because project ec0ecebd089a4e479f6909fed9101d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:02.442572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.443222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.445529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1007/2003] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:02 2022] DELETE /identity/v3/projects/ec0ecebd089a4e479f6909fed9101d0e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:02.446365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.447656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.498783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-52f69357-8803-4b0c-bab4-a2e0f25e90a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0577e29f9a5d4501b7885166b1673250'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:02.505357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 997/2004] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:01 2022] DELETE /identity/v3/users/0577e29f9a5d4501b7885166b1673250 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:02.507404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ebeb-e9e2-4f91-8da9-384a16ef1d7c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.507721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ebeb-e9e2-4f91-8da9-384a16ef1d7c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.513967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5ebeb-e9e2-4f91-8da9-384a16ef1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.523635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac43d-d81a-4cb3-9d17-d7c6322ec2ee admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.526839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cbe5ebeb-e9e2-4f91-8da9-384a16ef1d7c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:02.528062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cbe5ebeb-e9e2-4f91-8da9-384a16ef1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.583137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.583813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.584095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.584524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.585337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.586981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181edb4-9fec-4e78-afe1-954c390eb119 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.591363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 998/2005] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:02.592781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.593144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.593555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.601001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1008/2006] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:02.601001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.601001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.601001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.613639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:02.614858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.620160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:02.621337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.623820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 999/2007] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:02.624795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.626087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.629942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1009/2008] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:02.634153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:02.634764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.639372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088a0e-a511-40bc-87e6-1d1f70ccdc39 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.644414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749a1e-3f7a-4192-bf17-60059a009043 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.644589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.645434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.645609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.645904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.646631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.648778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.649978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.650635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.650943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.651221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.651933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:02.652236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.654062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.659477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1000/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:02.660291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.662102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.666578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1010/2010] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:17:02.667372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.677247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7d1c8-bc54-40c4-a416-2fcc245b5384 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.682601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.683513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.685685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.685685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] PATH_INFO: `/v3/projects/37e548c2722a4606bf4dbc6791cbbe1b/users/d2273269a8c14cd5adb95c32449766bc/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.700246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e548c2722a4606bf4dbc6791cbbe1b, user_id=d2273269a8c14cd5adb95c32449766bc, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.702951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4fd08-96bf-4cd9-9acd-2a0e1f3032e3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.723273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a7fd-3a49-4362-8b1d-d46eab2780a7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.729934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.729934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.729934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.729934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.737239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.738702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.749711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1001/2011] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:02.750474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.760399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50514eac-2a14-4064-b3aa-2d4b71796a59 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.765187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.765868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.766152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.766429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.767246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.769088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.774698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:02.781054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1011/2012] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:02 2022] PUT /identity/v3/projects/37e548c2722a4606bf4dbc6791cbbe1b/users/d2273269a8c14cd5adb95c32449766bc/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:02.792053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.792346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.792629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.824434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] MFA Rules not processed for user `d2273269a8c14cd5adb95c32449766bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:02.825692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:02.844269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1002/2013] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:02.848402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.900118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1012/2014] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:02.904691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:02.923269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63621-1204-4fbd-8fd6-5fd7d236db9a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.930172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.930882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.931173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.931454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.932192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.934242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:02.981380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62629-511e-4e2d-958f-cda3637b5c04 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:02.989379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:02.989379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:02.989379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:02.989379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:02.989750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:02.991723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.041949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1003/2015] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:03.043909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.058787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098bf2-dbbc-4910-8b72-126430e1e892 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.065464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.066191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.066479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.066761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.067502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.069820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.082738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1004/2016] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:17:03.088832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.094905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1013/2017] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:02 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:03.098704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.102717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d863b-0f47-4c46-9d45-1cda66c0fd20 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.152622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.167070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fc809-9505-4f7f-86f4-bdf9bbd9a198 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.172219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.172521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.172906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.173187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.173452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.173560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.173815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.173815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.174228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.174513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.175921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.176422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.193401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1005/2018] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:03.194324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.196277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.209508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0e2cb-2f66-4568-be7a-3559f6af8b6b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.214452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.215314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.215602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.215918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] PATH_INFO: `/v3/projects/1926f35c2b8c4913b0baf766b7b64930` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.217125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1926f35c2b8c4913b0baf766b7b64930)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.219150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.253416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1014/2019] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:03.254473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.259796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.265016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced07e64-71b0-49b2-918d-e8f20a5f5371 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.269787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.270751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.270983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.271318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] PATH_INFO: `/v3/projects/a0ec4ebe646c479ca36a1f8f8fb39f3f/users/137ef1ba294b48938e103fd8f0d6a508/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.286308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ec4ebe646c479ca36a1f8f8fb39f3f, user_id=137ef1ba294b48938e103fd8f0d6a508, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.289545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.362735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1015/2020] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:03 2022] PUT /identity/v3/projects/a0ec4ebe646c479ca36a1f8f8fb39f3f/users/137ef1ba294b48938e103fd8f0d6a508/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:03.363721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.385688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1926f35c2b8c4913b0baf766b7b64930', 'request_id': 'req-a35aad01-2460-4772-8acc-5b31b28ae509'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:03.393397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1926f35c2b8c4913b0baf766b7b64930', 'request_id': 'req-a35aad01-2460-4772-8acc-5b31b28ae509'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:03.441192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdafb3-3c8b-4304-82fe-a50c9c8b824c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.469523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1926f35c2b8c4913b0baf766b7b64930', 'request_id': 'req-a35aad01-2460-4772-8acc-5b31b28ae509'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:03.482647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] The token cache is being invalidate because project 1926f35c2b8c4913b0baf766b7b64930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:03.484357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:03.484357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a35aad01-2460-4772-8acc-5b31b28ae509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:03.489220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1006/2021] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:03 2022] DELETE /identity/v3/projects/1926f35c2b8c4913b0baf766b7b64930 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:03.489220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb111a8-28b7-4b4f-9018-379b9b4312cf None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.489220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb111a8-28b7-4b4f-9018-379b9b4312cf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.489220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb111a8-28b7-4b4f-9018-379b9b4312cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.502312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.502973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.503255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.503563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.504282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.505978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cbd78-a735-4093-90a1-eaf849f7d38d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.516393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5bb111a8-28b7-4b4f-9018-379b9b4312cf None None] MFA Rules not processed for user `137ef1ba294b48938e103fd8f0d6a508`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:03.517382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1016/2022] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:03.517930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5bb111a8-28b7-4b4f-9018-379b9b4312cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.518969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.520142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.520524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.539370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:03.540514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.548580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1017/2023] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:03.549403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.550756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.563403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fffbe-d52c-404e-a748-c5d6e3f16dab None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.568058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.569119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.569401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.569714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] PATH_INFO: `/v3/projects/f0769d72a9c04a25920fdfa023200db0/users/4d5bd652661546b1ad114c2b08c08458/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.585467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0769d72a9c04a25920fdfa023200db0, user_id=4d5bd652661546b1ad114c2b08c08458, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.588370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.593623 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1007/2024] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:03.594992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.595289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.595569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.613887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:03.615117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.623765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1008/2025] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:03.624544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.625868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:03.638141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1018/2026] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:03 2022] PUT /identity/v3/projects/f0769d72a9c04a25920fdfa023200db0/users/4d5bd652661546b1ad114c2b08c08458/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:03.638533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bc24-1e2b-4ec7-a088-6ef8c703b40a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.639039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.687193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.694851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.696087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.696921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.697267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.697551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.698282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.700183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.706907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab784-1b64-463e-b2a2-6a3a4a382b20 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.712517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.713179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.713460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.713776 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.714494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:03.714801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.716410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.729003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1019/2027] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:03.730030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.740285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550367-60ab-404b-88c2-cd83a09ee4ce admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.746093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.746764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.747031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.747307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.748023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.749642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.760423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1020/2028] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:03.761278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.769405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1009/2029] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:03.770355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.771199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9f808-4c13-47f3-b8b1-11e869c5a1fc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.837393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.838096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.838375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.838495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201272ea-78cc-41ee-94b1-1eb41dbc0f81 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.838657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.839326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.841530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.843362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.844256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.844541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.844830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] PATH_INFO: `/v3/projects/f0769d72a9c04a25920fdfa023200db0/users/4d5bd652661546b1ad114c2b08c08458/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.846893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0769d72a9c04a25920fdfa023200db0, user_id=4d5bd652661546b1ad114c2b08c08458, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.849632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:03.861007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1010/2030] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:03 2022] PUT /identity/v3/projects/f0769d72a9c04a25920fdfa023200db0/users/4d5bd652661546b1ad114c2b08c08458/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:03.861929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.916898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1021/2031] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:03.921383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:03.938212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9773-07d9-4cf5-9eb8-220283b31887 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.986151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b2e5c-710b-4930-8877-a4e3641b3b61 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:03.991930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:03.992693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:03.992917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:03.993197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:03.993925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:03.996064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e463a8-76df-4468-b909-323fdb88dece admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.000019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.000711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.000995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.001298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.002052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.004004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.113807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1022/2032] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:04.113807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.113807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.113807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.139058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1011/2033] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:03 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:04.139058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.147549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61659fd-ddf6-4cb1-810f-349d10273632 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.151917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] MFA Rules not processed for user `4d5bd652661546b1ad114c2b08c08458`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:04.152730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.153177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.153533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.153854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.154136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.154869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.156536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.158974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:04.167935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1012/2034] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:04.168772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.180848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2f76c-1554-41f1-9218-3103f55ecd8f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.187421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.188448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.188833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.189181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.190127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.191849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.200493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:04.204268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1013/2035] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:04.205353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.217414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30a6c9-cd21-4ef7-8b59-7c0d083e6c31 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.222728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.223513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.223799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.224081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.224852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.226606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.232561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1023/2036] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:04.233503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.245257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1014/2037] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:04.245422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90adc7-0c53-4f31-8231-51b538236b2c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.246444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.249310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.250067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.250973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.251321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.251626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] PATH_INFO: `/v3/projects/839e71743dc3492ab71e82495f8b5019/users/c0cc01ddcb5049888ea258e45602cb72/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.271934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839e71743dc3492ab71e82495f8b5019, user_id=c0cc01ddcb5049888ea258e45602cb72, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.274910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.311836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de794b6-6b65-4fe0-9ea5-ef013e7ff929 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.315896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.316555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.316839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.317116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.319702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.386187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.387753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.397917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1015/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:04.398826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1024/2039] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:04 2022] PUT /identity/v3/projects/839e71743dc3492ab71e82495f8b5019/users/c0cc01ddcb5049888ea258e45602cb72/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:04.402598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.409015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.415737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6998a-dbc4-448d-a5d8-504d32338f42 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.486860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b278-dc2a-4f07-9775-e79de0126b30 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.490393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.492867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.493224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.493750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] PATH_INFO: `/v3/projects/0a5f19f7f8bf43b39608a1f8fdb3c0f1/users/b93996ac3afe4fc9b9fedc1150994208/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.495979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.496734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.497112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.497545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.498220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.499902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.515544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1025/2040] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:04.519625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.530750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5f19f7f8bf43b39608a1f8fdb3c0f1, user_id=b93996ac3afe4fc9b9fedc1150994208, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.535497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54c994-6d99-4df7-8d6e-c1fe3db71be7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.535659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cec93b-09ca-45c1-9ed4-7b095ca82231 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.551145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.552185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.552549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.553064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] PATH_INFO: `/v3/projects/839e71743dc3492ab71e82495f8b5019/users/c0cc01ddcb5049888ea258e45602cb72/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.555663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=839e71743dc3492ab71e82495f8b5019, user_id=c0cc01ddcb5049888ea258e45602cb72, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.558546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985410-d6a0-4707-92cc-fd9213366c5f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.575948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1026/2041] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:04 2022] PUT /identity/v3/projects/839e71743dc3492ab71e82495f8b5019/users/c0cc01ddcb5049888ea258e45602cb72/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:04.586443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.586813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.587161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.621505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] MFA Rules not processed for user `c0cc01ddcb5049888ea258e45602cb72`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:04.621505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.649370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1016/2042] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:04 2022] PUT /identity/v3/projects/0a5f19f7f8bf43b39608a1f8fdb3c0f1/users/b93996ac3afe4fc9b9fedc1150994208/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:04.659217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.659883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.660165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.689550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:04.692590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] MFA Rules not processed for user `b93996ac3afe4fc9b9fedc1150994208`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:04.694663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.698892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1027/2043] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:04.761222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1017/2044] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:04.773795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.775220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.776364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:04.778610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:04.798112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:04.839547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0e40-5444-4352-b8d9-9cae5b5a34cd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.844782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0ab4d-4b9a-41ee-ad22-5a55e717cf5e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:04.848691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.849364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.849802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.850135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.901095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:04.901839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:04.902429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:04.902429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:04.911917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.914023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.923399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1028/2045] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:04.924589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:04.926160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:04.937742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1018/2046] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:05.218572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:05.229240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ce86-04db-44ba-a0ae-0c9570c5bc77 service glance] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:05.233247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:05.233918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:05.234202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:05.234480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:05.295769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:05.297254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748118d-dccd-472f-9f68-7c2afb39d8d5 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:05.307706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1029/2047] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:06.098950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:06.100898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:06.154008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:06.166690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd0766-ad51-4c7e-a019-e83001ec4187 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:06.171266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:06.172137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:06.172419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:06.172695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] PATH_INFO: `/v3/users/72dc356f7a9d421786639eb8cb573377` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:06.173896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72dc356f7a9d421786639eb8cb573377)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:06.175818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:06.318289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72dc356f7a9d421786639eb8cb573377'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:06.326427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72dc356f7a9d421786639eb8cb573377'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:06.327285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72dc356f7a9d421786639eb8cb573377'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:06.340860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72dc356f7a9d421786639eb8cb573377'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:06.407422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72dc356f7a9d421786639eb8cb573377'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:06.415811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1019/2048] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:06 2022] DELETE /identity/v3/users/72dc356f7a9d421786639eb8cb573377 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:06.420600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:06.421053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:06.421165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:06.439332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:06.440647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:06.501123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:06.502827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:06.512634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1030/2049] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:06.521810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:06.523269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:06.546095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:06.622119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535fe2d-c2c3-4488-b864-91ca0a273e36 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:06.622119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:06.622119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:06.622119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:06.622723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:06.622723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:06.622879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3013-7ff2-43be-b1c3-92d85eb8cc6e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:06.622879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:06.622879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:06.622879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:06.623246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:06.623246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:06.623246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:06.633133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1031/2050] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:06.658760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:06.660215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a75d1-9a3c-4313-a853-dafa342a4b58 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:06.674363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1020/2051] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:07.258450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:07.258450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:07.281899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba155f-3233-47d9-ae44-d88c38d2087b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:07.300519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:07.302000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.303630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.304177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] PATH_INFO: `/v3/projects/45f1f169bb3a45158ce6f75fddb567d9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.306055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f1f169bb3a45158ce6f75fddb567d9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:07.308107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:07.452932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f1f169bb3a45158ce6f75fddb567d9', 'request_id': 'req-20746929-b658-43cf-8eb5-1a2f3d177b48'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:07.458836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f1f169bb3a45158ce6f75fddb567d9', 'request_id': 'req-20746929-b658-43cf-8eb5-1a2f3d177b48'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:07.585686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f1f169bb3a45158ce6f75fddb567d9', 'request_id': 'req-20746929-b658-43cf-8eb5-1a2f3d177b48'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:07.598496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] The token cache is being invalidate because project 45f1f169bb3a45158ce6f75fddb567d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:07.598775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:07.599632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20746929-b658-43cf-8eb5-1a2f3d177b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:07.602346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1032/2052] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:07 2022] DELETE /identity/v3/projects/45f1f169bb3a45158ce6f75fddb567d9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:07.607755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.608316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.608554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.631703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:07.632930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:07.655020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:07.703284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1021/2053] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:07.713056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.713361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.713668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.732195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:07.733391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:07.742376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1033/2054] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:07.746575 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:07.756235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc1881-65ff-4e26-9cd9-5eb56abc1f63 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:07.761130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:07.761897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.762179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.762456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.763209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:07.763511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:07.765100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:07.777280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1022/2055] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:07.781686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:07.792275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1858963-9ad8-4b6d-b44e-3969ed982ea7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:07.803063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:07.804712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.805046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.805323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.806151 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:07.808051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:07.906896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1034/2056] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:07 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:07.911104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:07.922029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf48cf-e105-491b-8ba6-3b9584f4cb4c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:07.981896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:07.982573 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:07.982862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:07.983267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:07.984082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:07.986049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.122650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1023/2057] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:07 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:08.126727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.137566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3dcca-0436-416e-bdfd-16a71dc1df3e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.147311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.147311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.147311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.147311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.147839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.147839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.159991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1035/2058] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:08.164488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.186833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25d185-3399-4b40-adfa-a7db1e491432 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.190536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.191323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.191679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.192413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.193261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.195657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.210108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1024/2059] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:08.214390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.226249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3407f-c297-4668-8ddd-f63a348e6bb0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.232619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.232619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.232900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.233154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] PATH_INFO: `/v3/projects/b96d3751648d46b5a1d2bbe45b093484/users/491fa72300f0481a92093428061543fd/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.252174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96d3751648d46b5a1d2bbe45b093484, user_id=491fa72300f0481a92093428061543fd, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.254923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68312b-b68d-436f-b56e-2b8964b8dadd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.322377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.324070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:08.335058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1036/2060] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:08 2022] PUT /identity/v3/projects/b96d3751648d46b5a1d2bbe45b093484/users/491fa72300f0481a92093428061543fd/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:08.346457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.349268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.349268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.375420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] MFA Rules not processed for user `491fa72300f0481a92093428061543fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:08.376682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:08.388920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5af3-30f9-4039-b8d6-439b0f43ef43 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.404527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:08.444200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:08.448662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1037/2061] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:08.450348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.458471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.458471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.458471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.458471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:08.460676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.462099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:08.475000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8b69e-8662-4236-b78d-85d668262ecd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.479933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.480635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.481804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.482104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.496731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.498247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.508285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1038/2062] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:08.529619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.531093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab4a28-a87b-498a-b072-bc7993f03665 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.532580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:08.545352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1025/2063] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:08.617210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799dbc-2355-4d88-956c-b6419b900b23 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:08.622079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:08.623289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.623625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.623904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] PATH_INFO: `/v3/users/491fa72300f0481a92093428061543fd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.625133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491fa72300f0481a92093428061543fd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:08.628485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:08.856615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491fa72300f0481a92093428061543fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:08.857307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491fa72300f0481a92093428061543fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:08.866657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491fa72300f0481a92093428061543fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:08.878889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491fa72300f0481a92093428061543fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:08.956249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491fa72300f0481a92093428061543fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:08.963270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1039/2064] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:08 2022] DELETE /identity/v3/users/491fa72300f0481a92093428061543fd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:08.967832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:08.968329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:08.968422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:08.986187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:08.987417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:09.049546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1026/2065] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:09.059759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:09.061177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:09.098121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:09.122080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c89f-729a-4501-8505-1c94f30db883 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:09.126469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:09.127144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.127462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.127742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.138218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:09.139687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56333b-89db-47b6-aea5-a34f2fd5051d service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:09.149672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1040/2066] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:09.554005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:09.554669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:09.566995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf49d0-a6ae-4c61-b672-ad4c0617b36f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:09.572818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:09.573650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.573994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.574231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] PATH_INFO: `/v3/projects/b96d3751648d46b5a1d2bbe45b093484` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.575464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96d3751648d46b5a1d2bbe45b093484)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:09.577660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:09.682628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96d3751648d46b5a1d2bbe45b093484', 'request_id': 'req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:09.689063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96d3751648d46b5a1d2bbe45b093484', 'request_id': 'req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:09.759486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96d3751648d46b5a1d2bbe45b093484', 'request_id': 'req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:09.768554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] The token cache is being invalidate because project b96d3751648d46b5a1d2bbe45b093484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:09.768947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:09.769989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0f5307c6-d34b-4368-b4a2-8fbfb82f3129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:09.775641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1027/2067] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:09 2022] DELETE /identity/v3/projects/b96d3751648d46b5a1d2bbe45b093484 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:09.778203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.778980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.779458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.798915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:09.800246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:09.878078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1041/2068] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:09.880025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.880313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.880593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.899597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:09.900830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:09.910971 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1028/2069] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:09.916117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:09.925839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe3479-17d5-44cb-829c-c4b0f21e89c7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:09.931772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:09.932487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.932771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.933053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.933866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:09.934180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:09.935863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:09.948468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1042/2070] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:09.963883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:09.973255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83add943-0de8-419b-b9c4-aa51fc0d0add None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:09.978592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:09.979298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:09.979585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:09.979864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:09.980607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:09.982631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:09.997911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:10.101756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1029/2071] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:09 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:10.106594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:10.117789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde09d2a-57e4-40f5-8a8f-0bca4cd731e4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:10.175239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:10.175918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.176203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.176483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.177185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:10.179568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:10.300574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1043/2072] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:10 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:10.311937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:10.323408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984c27-3ee4-4742-9ccf-735f95f3452a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:10.328229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:10.328970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.329342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.329724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.330533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:10.332715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:10.349128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1030/2073] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:10.366431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:10.376977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a4940-8f61-4afc-bf97-30be54bf4386 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:10.382310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:10.395868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.395868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.395868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.395868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:10.395868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e85a-16ff-4a5c-8085-f46056859e73 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:10.411074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1044/2074] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:10.417046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:10.429012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb56d9-c66f-4daa-b767-5bbe1b4c16ef admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:10.433934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:10.434847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.435127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.435686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] PATH_INFO: `/v3/projects/38fa57db738f4f9d8c4bc458590c58c2/users/9158febb4d7e404e9940a00ed657bab8/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.454382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fa57db738f4f9d8c4bc458590c58c2, user_id=9158febb4d7e404e9940a00ed657bab8, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:10.457376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:10.529904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1031/2075] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:10 2022] PUT /identity/v3/projects/38fa57db738f4f9d8c4bc458590c58c2/users/9158febb4d7e404e9940a00ed657bab8/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:10.540207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917ab83-8ff7-4da6-9aca-5fb22921dcfa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.540507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917ab83-8ff7-4da6-9aca-5fb22921dcfa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.540791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917ab83-8ff7-4da6-9aca-5fb22921dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.581454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9917ab83-8ff7-4da6-9aca-5fb22921dcfa None None] MFA Rules not processed for user `9158febb4d7e404e9940a00ed657bab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:10.582397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9917ab83-8ff7-4da6-9aca-5fb22921dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:10.641904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:10.682663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1045/2076] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:10.698637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:10.701291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:10.777602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b95de-e64b-4a25-aeb2-ad676617b1fd admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:10.781236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:10.781907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:10.782188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:10.782528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:10.791598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:10.793032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:10.804222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1032/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:17:12.623499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c979d-0d41-4ee2-8e6c-7b142361e9b1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:12.628530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c979d-0d41-4ee2-8e6c-7b142361e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:12.628530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c979d-0d41-4ee2-8e6c-7b142361e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:12.642053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-583c979d-0d41-4ee2-8e6c-7b142361e9b1 None None] MFA Rules not processed for user `9158febb4d7e404e9940a00ed657bab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:12.643283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-583c979d-0d41-4ee2-8e6c-7b142361e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:12.651004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1046/2078] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:13.346282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:13.347717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:13.420753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32f36-cfd3-454e-a979-022b1344b4a3 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:13.431322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:13.431322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:13.431322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:13.431322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] PATH_INFO: `/v3/users/31c430ee345c4303b6485e43177ba293` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:13.431669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c430ee345c4303b6485e43177ba293)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:13.433684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:13.684969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c430ee345c4303b6485e43177ba293'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:13.692442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c430ee345c4303b6485e43177ba293'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:13.693104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c430ee345c4303b6485e43177ba293'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:13.698465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:13.705946 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c430ee345c4303b6485e43177ba293'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:13.784836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c430ee345c4303b6485e43177ba293'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:13.792792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1033/2079] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:13 2022] DELETE /identity/v3/users/31c430ee345c4303b6485e43177ba293 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:13.797616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:13.798167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:13.798167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:13.818955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:13.824913 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:13.885644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1047/2080] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:13.896326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:13.898277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:13.963996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa88-2c73-4fee-b4d5-5ff388a3f42e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:13.967589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:13.968239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:13.968526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:13.968803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:13.979262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:13.980707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:13.991413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1034/2081] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:14.501686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:14.503247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:14.517406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b297e2-d600-4788-98b5-b830c8dab4d1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:14.523494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:14.524597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:14.524979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:14.525607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] PATH_INFO: `/v3/projects/cd8984c412094d299c7ccd993afb77ab` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:14.527080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8984c412094d299c7ccd993afb77ab)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:14.529351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:14.649711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8984c412094d299c7ccd993afb77ab', 'request_id': 'req-b273b426-441a-4f46-b8dd-2c1e35348f07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:14.655120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8984c412094d299c7ccd993afb77ab', 'request_id': 'req-b273b426-441a-4f46-b8dd-2c1e35348f07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:14.739492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8984c412094d299c7ccd993afb77ab', 'request_id': 'req-b273b426-441a-4f46-b8dd-2c1e35348f07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:14.754255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] The token cache is being invalidate because project cd8984c412094d299c7ccd993afb77ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:14.754546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:14.755216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:14.757453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1048/2082] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:14 2022] DELETE /identity/v3/projects/cd8984c412094d299c7ccd993afb77ab => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:14.761440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:14.771440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614feb-c408-400b-a201-9ef5b9a755e9 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:14.833731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:14.834934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:14.835442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:14.835681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] PATH_INFO: `/v3/users/d2273269a8c14cd5adb95c32449766bc` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:14.836882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2273269a8c14cd5adb95c32449766bc)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:14.838872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:15.110899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2273269a8c14cd5adb95c32449766bc'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.119497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2273269a8c14cd5adb95c32449766bc'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.120318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2273269a8c14cd5adb95c32449766bc'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.132787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2273269a8c14cd5adb95c32449766bc'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.213718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2273269a8c14cd5adb95c32449766bc'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.220237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1035/2083] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:14 2022] DELETE /identity/v3/users/d2273269a8c14cd5adb95c32449766bc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:15.703094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:15.705395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:15.721438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b426-441a-4f46-b8dd-2c1e35348f07 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:15.773451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:15.784545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:15.785438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:15.785864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:15.786147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] PATH_INFO: `/v3/projects/37e548c2722a4606bf4dbc6791cbbe1b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:15.787399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e548c2722a4606bf4dbc6791cbbe1b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:15.790293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:15.904857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e548c2722a4606bf4dbc6791cbbe1b', 'request_id': 'req-9b3b01a8-6564-47b8-bc02-4b1237800401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:15.910983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e548c2722a4606bf4dbc6791cbbe1b', 'request_id': 'req-9b3b01a8-6564-47b8-bc02-4b1237800401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.001900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e548c2722a4606bf4dbc6791cbbe1b', 'request_id': 'req-9b3b01a8-6564-47b8-bc02-4b1237800401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.014064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] The token cache is being invalidate because project 37e548c2722a4606bf4dbc6791cbbe1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:16.014347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.014991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.016527 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1049/2084] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:15 2022] DELETE /identity/v3/projects/37e548c2722a4606bf4dbc6791cbbe1b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:16.020718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:16.024100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:16.035321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:16.041910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6022-54ac-4deb-86b3-7932bded861a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:16.105549 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:16.106461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:16.106748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:16.107028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] PATH_INFO: `/v3/users/4d5bd652661546b1ad114c2b08c08458` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:16.108581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5bd652661546b1ad114c2b08c08458)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:16.110654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:16.327410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5bd652661546b1ad114c2b08c08458'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.335835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5bd652661546b1ad114c2b08c08458'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.336764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5bd652661546b1ad114c2b08c08458'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.356324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5bd652661546b1ad114c2b08c08458'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.453949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4de80961-814f-4a56-9b12-b3597f714a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5bd652661546b1ad114c2b08c08458'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:16.461107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1036/2085] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:16 2022] DELETE /identity/v3/users/4d5bd652661546b1ad114c2b08c08458 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:17.313607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:17.315296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:17.337735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b01a8-6564-47b8-bc02-4b1237800401 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:17.409466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:17.410508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:17.410797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:17.411076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] PATH_INFO: `/v3/projects/f0769d72a9c04a25920fdfa023200db0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:17.412404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0769d72a9c04a25920fdfa023200db0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:17.414456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:17.613016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0769d72a9c04a25920fdfa023200db0', 'request_id': 'req-c06beef2-4b72-47dd-951a-7fe568a7441e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:17.621417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0769d72a9c04a25920fdfa023200db0', 'request_id': 'req-c06beef2-4b72-47dd-951a-7fe568a7441e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:17.762262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0769d72a9c04a25920fdfa023200db0', 'request_id': 'req-c06beef2-4b72-47dd-951a-7fe568a7441e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:17.775117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] The token cache is being invalidate because project f0769d72a9c04a25920fdfa023200db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:17.775506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:17.776238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06beef2-4b72-47dd-951a-7fe568a7441e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:17.778058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1050/2086] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:17 2022] DELETE /identity/v3/projects/f0769d72a9c04a25920fdfa023200db0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:17.783041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:17.783603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:17.783715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:17.802491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:17.806950 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:17.877743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1037/2087] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:17.887723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:17.887723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:17.887723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:17.910235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:17.910988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:17.920299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1051/2088] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:17.924804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:17.938525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187e7b4-9fe7-4949-8607-1e18a932a756 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:17.944688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:17.945464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:17.945859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:17.946207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:17.947024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:17.947458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:17.949199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:17.967132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1038/2089] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:17.971961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:17.977513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:17.985183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf87d-2156-425e-b979-adcdb225a48c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:17.993027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:17.993977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:17.994253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:17.994553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:17.995273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:17.997703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.087509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1052/2090] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:17 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:18.091537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:18.107387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a69bb-6e99-4228-ad5a-9a0d660d8b84 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:18.115039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:18.204411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:18.204411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.204411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.204411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.204922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:18.204922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.293428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1039/2091] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:18 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:18.297941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:18.311356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005734-7121-491f-a1bd-a81e9638ede7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:18.317059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:18.318381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.319545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.319545 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.320645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:18.322786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.338159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1053/2092] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:17:18.344318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:18.358228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035583e-22fc-415b-b5c3-5ec2be304215 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:18.367078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:18.368224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.368613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.369721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.370723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:18.372784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781adda8-ee20-4a90-bb3b-f74684dfc237 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.386562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1040/2093] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:18.390230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:18.402908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceddb9-3c14-425a-9ee0-598b5d800989 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:18.408869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:18.411259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.411259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.411259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] PATH_INFO: `/v3/projects/acb791f8c00e4aa4aacfadf23fa87b94/users/8e873322c2724be084dc009402dcb4ba/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.429186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb791f8c00e4aa4aacfadf23fa87b94, user_id=8e873322c2724be084dc009402dcb4ba, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:18.432027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.531351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1054/2094] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:18 2022] PUT /identity/v3/projects/acb791f8c00e4aa4aacfadf23fa87b94/users/8e873322c2724be084dc009402dcb4ba/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:18.536616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7069b-7736-4e65-9c8a-e03f18322b45 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.536902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7069b-7736-4e65-9c8a-e03f18322b45 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.537184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7069b-7736-4e65-9c8a-e03f18322b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.558041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f8c7069b-7736-4e65-9c8a-e03f18322b45 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:18.559377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f8c7069b-7736-4e65-9c8a-e03f18322b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:18.652646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1041/2095] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:18.666301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:18.672634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:18.757542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d194-3b8f-49a6-95b9-92202cd79a9e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:18.766874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:18.766874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:18.766874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:18.767197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:18.778657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:18.780038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:18.794166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1055/2096] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:20.661643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a82878-801b-4a08-bfd5-82ab934c80df None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:20.662196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a82878-801b-4a08-bfd5-82ab934c80df None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:20.662542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a82878-801b-4a08-bfd5-82ab934c80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:20.708582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c6a82878-801b-4a08-bfd5-82ab934c80df None None] MFA Rules not processed for user `8e873322c2724be084dc009402dcb4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:20.709551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c6a82878-801b-4a08-bfd5-82ab934c80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:20.813886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1042/2097] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:20.826042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:20.827474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:20.898758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8eb30-8313-4cd0-b7e5-dfa41f4d8161 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:20.902796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:20.905218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:20.905218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:20.905218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:20.942780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:20.945268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dfb88-ad2d-4a8f-8f61-f796043547bf service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:20.956026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1056/2098] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:23.815767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.816401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.816401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.835656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] MFA Rules not processed for user `8e873322c2724be084dc009402dcb4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:23.836638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.844577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1043/2099] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:30.951257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=75,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:33.829897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:37.573866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e457-947e-46ca-8922-472d42c5bd9f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:37.574377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e457-947e-46ca-8922-472d42c5bd9f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:37.574470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e457-947e-46ca-8922-472d42c5bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:37.596984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0d27e457-947e-46ca-8922-472d42c5bd9f None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:37.596984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d27e457-947e-46ca-8922-472d42c5bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:37.688845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1057/2100] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:37.734488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:37.736633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:37.828769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3bee8-2e07-41f8-97e0-7e6c25c564f9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:37.838540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:37.839362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:37.839918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:37.840510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:37.856614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:37.862114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:37.873082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1044/2101] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:38.924663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000d6a0-b06b-4b35-af08-6db01d1e3c0e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:38.925118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000d6a0-b06b-4b35-af08-6db01d1e3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:38.925273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000d6a0-b06b-4b35-af08-6db01d1e3c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:38.951720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f000d6a0-b06b-4b35-af08-6db01d1e3c0e None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:38.953569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f000d6a0-b06b-4b35-af08-6db01d1e3c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:38.964423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1058/2102] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:38.982494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:38.996788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317a26-cd7c-43ff-a15b-62fc528ace48 service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:39.003511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:39.004466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:39.005215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:39.005215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:39.016069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:39.018127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:39.047732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1045/2103] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:39.923085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:39.923381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:39.923666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:39.947949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:39.949198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:39.957177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1059/2104] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:39.972853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:39.984651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9b61-23e5-4e36-978d-f9abdd95896c service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:39.993373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:39.994072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:39.994353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:39.994629 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:40.004937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:40.007598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8725bfd-c830-4100-9f60-64cf18794438 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:40.016873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1046/2105] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:40.065199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:40.066777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:40.090509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f102d54-bad4-4888-a8eb-9d5a874bd6ce None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:40.095537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:40.096574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:40.097090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:40.097233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] PATH_INFO: `/v3/users/b93996ac3afe4fc9b9fedc1150994208` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:40.099773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93996ac3afe4fc9b9fedc1150994208)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:40.102100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:40.411168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93996ac3afe4fc9b9fedc1150994208'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:40.411821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93996ac3afe4fc9b9fedc1150994208'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:40.419957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93996ac3afe4fc9b9fedc1150994208'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:40.433462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93996ac3afe4fc9b9fedc1150994208'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:40.511429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93996ac3afe4fc9b9fedc1150994208'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:40.518123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1060/2106] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:40 2022] DELETE /identity/v3/users/b93996ac3afe4fc9b9fedc1150994208 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:40.526435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d5e3e-ab45-4c8b-b534-2ce0b81f1f59 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:40.526724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d5e3e-ab45-4c8b-b534-2ce0b81f1f59 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:40.527094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d5e3e-ab45-4c8b-b534-2ce0b81f1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:40.548246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ef2d5e3e-ab45-4c8b-b534-2ce0b81f1f59 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:40.548246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ef2d5e3e-ab45-4c8b-b534-2ce0b81f1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:40.640124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1047/2107] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:40.650668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:40.652266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:40.735293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8177-f780-42fb-8a89-467bc536a76a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:40.743292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:40.744329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:40.744329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:40.744561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:40.791542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:40.810276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:40.834074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1061/2108] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:40.883815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:40.884345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:40.884594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:40.924751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:40.927374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:41.052634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1048/2109] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:41.074726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:41.077759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:41.090149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:41.164824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972202-d00b-40e2-9734-f9596e238083 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:41.174835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:41.175507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:41.175795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:41.176076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:41.186468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:41.188021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de9b11-8fdc-4876-b24b-aee30b8c9ece service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:41.197861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1062/2110] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:17:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:41.592104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:41.592104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:41.608344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996001f-7f73-45e0-9967-4acb0ec8c501 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:41.613450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:41.614628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:41.614916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:41.615315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] PATH_INFO: `/v3/projects/0a5f19f7f8bf43b39608a1f8fdb3c0f1` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:41.617239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5f19f7f8bf43b39608a1f8fdb3c0f1)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:41.631586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:41.631586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:41.755287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5f19f7f8bf43b39608a1f8fdb3c0f1', 'request_id': 'req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:41.764125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5f19f7f8bf43b39608a1f8fdb3c0f1', 'request_id': 'req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:41.861662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5f19f7f8bf43b39608a1f8fdb3c0f1', 'request_id': 'req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:41.898869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] The token cache is being invalidate because project 0a5f19f7f8bf43b39608a1f8fdb3c0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:41.898869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:41.898869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-a9559ddf-f42e-4a65-b1c7-e4ad127a2041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:41.899077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1049/2111] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:41 2022] DELETE /identity/v3/projects/0a5f19f7f8bf43b39608a1f8fdb3c0f1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:41.907410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:41.907701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:41.907982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:41.935626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:41.937888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:42.052324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1063/2112] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:42.065934 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.066630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.067021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.108359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:42.111036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:42.121622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1050/2113] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:42.126553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.143234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ed9d-7ce3-4228-9c12-6256fe1272f7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.165034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.166066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.166592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.173501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.173501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:42.173501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.173501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.189324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1064/2114] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:42.194713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.210699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0daa4-a033-4421-9f3c-3c8dedd1fb3a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.218941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.219591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.219967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.220144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.221082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.223172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.368545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1051/2115] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:42 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:42.373056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.385312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d810-004b-4ed6-896e-3e117a070192 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.450901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.451623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.451916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.452197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.452898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.454895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.567173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1065/2116] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:42 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:42.575719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.596769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e7b2-4557-4b27-a743-6e45a620a497 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.605711 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.606512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.606842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.607381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.608290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.610303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.632666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1052/2117] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:42.637223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.654419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91ed86-097b-4590-a1fc-6d9715cecc09 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.662352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.663745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.664078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.664403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.665172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.669181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c34b-c8f0-4c10-bf7c-f0b13e63b37e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.682245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1066/2118] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:42.687147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.704778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37187-407b-4eb8-8b25-fd7b6047a35a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:42.711838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:42.712751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.713071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.713354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] PATH_INFO: `/v3/projects/dc87a999dad84f3b85259084d38cc93c/users/381ef8fa6a804a08a85ed19503c12daf/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.731826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc87a999dad84f3b85259084d38cc93c, user_id=381ef8fa6a804a08a85ed19503c12daf, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:42.736265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:42.839846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1053/2119] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:42 2022] PUT /identity/v3/projects/dc87a999dad84f3b85259084d38cc93c/users/381ef8fa6a804a08a85ed19503c12daf/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:42.844934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:42.845279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:42.845600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:42.851915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:42.865203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:42.866823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:42.942388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1067/2120] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:42.958482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:42.961163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:43.030622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200918d-fb77-4db3-bec3-dd86a9beaeb5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:43.034378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:43.035058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:43.035438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:43.035745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:43.046342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:43.047898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105071d-7be8-469f-a681-b2a68368b59e service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:43.059865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1054/2121] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:45.466696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:45.469884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:45.488505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bbca4-7508-4f5d-829e-46410e44ae9e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:45.494570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:45.495734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:45.496173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:45.496629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] PATH_INFO: `/v3/users/9158febb4d7e404e9940a00ed657bab8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:45.499036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9158febb4d7e404e9940a00ed657bab8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:45.501247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:45.752206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9158febb4d7e404e9940a00ed657bab8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:45.752919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9158febb4d7e404e9940a00ed657bab8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:45.786098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9158febb4d7e404e9940a00ed657bab8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:45.816842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9158febb4d7e404e9940a00ed657bab8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:45.889299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9158febb4d7e404e9940a00ed657bab8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:45.899363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1068/2122] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:45 2022] DELETE /identity/v3/users/9158febb4d7e404e9940a00ed657bab8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:45.912039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:45.913829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:45.914818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:46.006291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:46.006291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:46.045612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:46.127328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1055/2123] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:46.138238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:46.139835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:46.262390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78889-946d-45d9-8016-81e704f1d4d9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:46.268500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:46.273283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:46.273283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:46.273283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:46.281767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:46.283380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece687d-2915-4c43-8af1-8d618d88f620 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:46.295859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1069/2124] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:46.886893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:46.892470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:46.907801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e985b-3b46-409d-9a9e-c37598a0517e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:46.932030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:46.937243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:46.937243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:46.937243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] PATH_INFO: `/v3/projects/38fa57db738f4f9d8c4bc458590c58c2` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:46.937243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fa57db738f4f9d8c4bc458590c58c2)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:46.939030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:47.102918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fa57db738f4f9d8c4bc458590c58c2', 'request_id': 'req-7f7912e2-1d91-478c-8ff9-8c5e946ef333'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:47.121177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fa57db738f4f9d8c4bc458590c58c2', 'request_id': 'req-7f7912e2-1d91-478c-8ff9-8c5e946ef333'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:47.192511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fa57db738f4f9d8c4bc458590c58c2', 'request_id': 'req-7f7912e2-1d91-478c-8ff9-8c5e946ef333'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:47.213303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] The token cache is being invalidate because project 38fa57db738f4f9d8c4bc458590c58c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:47.213952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:47.215550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-7f7912e2-1d91-478c-8ff9-8c5e946ef333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:47.218401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1056/2125] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:46 2022] DELETE /identity/v3/projects/38fa57db738f4f9d8c4bc458590c58c2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:47.225537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:47.229697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:47.229697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:47.255756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:47.259855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:47.285098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:47.381662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1070/2126] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:47.390012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:47.390377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:47.390651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:47.421196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:47.422634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:47.441552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1057/2127] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:47.446466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:47.463872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70600374-c8af-49f3-8f1f-dec0a573c5b3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:47.470187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:47.479617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:47.502684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1071/2128] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:47.506858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:47.521353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f720860-fcff-4e99-a2ad-c4af575d4a34 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:47.530513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:47.531557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:47.532013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:47.532450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:47.533534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:47.537227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:47.658865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1058/2129] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:47 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:47.665071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:47.718841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfe80a-8245-487d-94e8-fbc85cd30560 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:47.939140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:47.940125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:47.940728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:47.941679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:47.942577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:47.945481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:48.193235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1072/2130] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:47 2022] POST /identity/v3/users => generated 294 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:48.199793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:48.218873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf80c-4aff-49d8-9848-3945ced50bae admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:48.232041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:48.232984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.233382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.234149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.236668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:48.239184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:48.257675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1059/2131] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:48.261904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:48.283461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690314c-3368-4b59-9e0b-1f70ecc1f118 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:48.289910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:48.291252 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.291784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.292297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.293743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:48.296503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b92ac-fb00-4844-bada-44b9411852b3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:48.316291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1073/2132] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:48.317435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:48.329824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67e9f-da5c-4ccb-885c-ef09acbaf429 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:48.336144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:48.345156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.345156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.345156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] PATH_INFO: `/v3/projects/a30aea062bf24c7287848b3200629bd9/users/75f4c2af9fdb4d1995bdf304b76a239d/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.354955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30aea062bf24c7287848b3200629bd9, user_id=75f4c2af9fdb4d1995bdf304b76a239d, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:48.357921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:48.479096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1060/2133] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:48 2022] PUT /identity/v3/projects/a30aea062bf24c7287848b3200629bd9/users/75f4c2af9fdb4d1995bdf304b76a239d/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:48.492371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615b35-5079-453d-92ab-873ac84ecd17 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.492824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615b35-5079-453d-92ab-873ac84ecd17 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.493114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615b35-5079-453d-92ab-873ac84ecd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.524711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9d615b35-5079-453d-92ab-873ac84ecd17 None None] MFA Rules not processed for user `75f4c2af9fdb4d1995bdf304b76a239d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:48.526025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d615b35-5079-453d-92ab-873ac84ecd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:48.639409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1074/2134] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:48.659108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:48.661200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:48.699081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.699381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.699724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.722812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] MFA Rules not processed for user `8b273bb179aa4dc987fd7f67c7131724`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:48.728169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:48.836320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa9dd-987f-4d4f-b5a8-ed0b97458840 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:48.840327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1075/2135] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:48.841066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:48.842234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:48.842519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:48.842849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:48.850064 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:48.860121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:48.860121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531b31-a441-46a3-9292-cc77ebc6eec1 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:48.884849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1061/2136] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:49.639459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:49.641172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:49.795885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a4d3-da79-4773-9ad2-603cfac66ed0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:49.811696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:49.812779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:49.813364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:49.816610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] PATH_INFO: `/v3/users/137ef1ba294b48938e103fd8f0d6a508` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:49.816610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137ef1ba294b48938e103fd8f0d6a508)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:49.818378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:49.898498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:50.109824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137ef1ba294b48938e103fd8f0d6a508'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:50.110790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137ef1ba294b48938e103fd8f0d6a508'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:50.124993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137ef1ba294b48938e103fd8f0d6a508'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:50.150194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137ef1ba294b48938e103fd8f0d6a508'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:50.245244 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137ef1ba294b48938e103fd8f0d6a508'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:50.262120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1076/2137] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:49 2022] DELETE /identity/v3/users/137ef1ba294b48938e103fd8f0d6a508 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:50.266780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987034-50ee-47ac-b266-63a48c183dda None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:50.268118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987034-50ee-47ac-b266-63a48c183dda None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:50.268640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987034-50ee-47ac-b266-63a48c183dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:50.296716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-77987034-50ee-47ac-b266-63a48c183dda None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:50.298158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-77987034-50ee-47ac-b266-63a48c183dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:50.378848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1062/2138] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:50.393051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:50.395587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:50.500409 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d19fff-f99f-4db1-9983-08a5cd270825 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:50.504568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:50.505235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:50.505522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:50.505834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:50.518690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:50.520164 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:50.536748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1077/2139] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:51.215615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:51.219017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:51.219017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:51.240895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] MFA Rules not processed for user `8e873322c2724be084dc009402dcb4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:51.242742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:51.329082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1063/2140] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:51.495423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:52.272521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:52.274328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:52.291454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa022d4-7449-48d7-9b0e-956132eef87b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:52.297719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:52.298789 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:52.299291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:52.299697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] PATH_INFO: `/v3/projects/a0ec4ebe646c479ca36a1f8f8fb39f3f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:52.301285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ec4ebe646c479ca36a1f8f8fb39f3f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:52.304436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:52.435803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ec4ebe646c479ca36a1f8f8fb39f3f', 'request_id': 'req-97c78320-8c3d-4185-8061-753876c04f3d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.444008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ec4ebe646c479ca36a1f8f8fb39f3f', 'request_id': 'req-97c78320-8c3d-4185-8061-753876c04f3d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.522939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ec4ebe646c479ca36a1f8f8fb39f3f', 'request_id': 'req-97c78320-8c3d-4185-8061-753876c04f3d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.536209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] The token cache is being invalidate because project a0ec4ebe646c479ca36a1f8f8fb39f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:52.536508 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.537212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-97c78320-8c3d-4185-8061-753876c04f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.539788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1078/2141] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:52 2022] DELETE /identity/v3/projects/a0ec4ebe646c479ca36a1f8f8fb39f3f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:52.544047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:52.562314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18163d-2e50-4c4e-9bb7-4373ade380a9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:52.631292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:52.632206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:52.632494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:52.632786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] PATH_INFO: `/v3/users/c0cc01ddcb5049888ea258e45602cb72` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:52.635007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cc01ddcb5049888ea258e45602cb72)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:52.638620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:52.894804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:52.904046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cc01ddcb5049888ea258e45602cb72'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.916211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cc01ddcb5049888ea258e45602cb72'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.917223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cc01ddcb5049888ea258e45602cb72'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:52.934954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cc01ddcb5049888ea258e45602cb72'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:53.037756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cc01ddcb5049888ea258e45602cb72'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:53.047325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1064/2142] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:52 2022] DELETE /identity/v3/users/c0cc01ddcb5049888ea258e45602cb72 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:53.369973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:53.371241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:53.371897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:53.438106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] MFA Rules not processed for user `381ef8fa6a804a08a85ed19503c12daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:53.440974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:53.583077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:53.589738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:53.594667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1079/2143] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:53.690645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777a3b-c531-470c-b090-340cd345e248 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:53.696922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:53.699686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:53.699686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:53.699686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:53.699686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:53.702088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:53.812311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:53.814385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:53.828526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1065/2144] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:53 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:53.837047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:53.841755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87245a4-b4b8-465a-b029-658237788af3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:53.940894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:53.952768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:53.954070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:53.954070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:53.954374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] PATH_INFO: `/v3/projects/839e71743dc3492ab71e82495f8b5019` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:53.955592 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] RBAC: Authorizing `identity:delete_project(project_id=839e71743dc3492ab71e82495f8b5019)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:53.957977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:53.966989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f9e19-1e61-433a-865b-2324637e2d19 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:53.976157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:53.977110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:53.977468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:53.977887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:53.979685 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:53.983258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.142914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1066/2145] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:53 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:54.154382 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.166628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839e71743dc3492ab71e82495f8b5019', 'request_id': 'req-58659e7f-9700-438c-a2fa-b2fe6f89598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:54.169562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b1abe-35d0-4830-b3ae-270d3f628812 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.187166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839e71743dc3492ab71e82495f8b5019', 'request_id': 'req-58659e7f-9700-438c-a2fa-b2fe6f89598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:54.218537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:54.247856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.248795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.249083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.249367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.250475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.252132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.271420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839e71743dc3492ab71e82495f8b5019', 'request_id': 'req-58659e7f-9700-438c-a2fa-b2fe6f89598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:54.279187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1067/2146] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:54.280547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.291085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] The token cache is being invalidate because project 839e71743dc3492ab71e82495f8b5019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:54.291386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:54.292696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-58659e7f-9700-438c-a2fa-b2fe6f89598e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:54.295783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1080/2147] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:53 2022] DELETE /identity/v3/projects/839e71743dc3492ab71e82495f8b5019 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:54.302378 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066a79-28e6-4764-baed-68b2f843857d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.302822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066a79-28e6-4764-baed-68b2f843857d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.303207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86066a79-28e6-4764-baed-68b2f843857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.305866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56d748-4e4a-4226-85c0-206ef6f83d56 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.315280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.317138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.317138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.317138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] PATH_INFO: `/v3/projects/51371f53aa594df9a9e73d4d1f37af6c/users/5b368d3c2ad5415b9f29e0dce8621830/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.332485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-86066a79-28e6-4764-baed-68b2f843857d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:54.337241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-86066a79-28e6-4764-baed-68b2f843857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:54.345388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51371f53aa594df9a9e73d4d1f37af6c, user_id=5b368d3c2ad5415b9f29e0dce8621830, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.348539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.362114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1081/2148] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:54.365344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.365673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.365958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.390666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:54.391885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:54.403825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1082/2149] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:54.404987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.424511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19964b-497d-409e-9c90-1b87963a8c1f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.437601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1068/2150] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:54 2022] PUT /identity/v3/projects/51371f53aa594df9a9e73d4d1f37af6c/users/5b368d3c2ad5415b9f29e0dce8621830/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:54.440655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.442531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:54.521514 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.530935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.531613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.531613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.532341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:54.532685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.534505 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.544216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94609-690d-4c01-b501-d2615f9af573 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.551057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.551755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.552768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.553277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.554596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.566498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.578145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1069/2151] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:17:54.579259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1083/2152] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:54.582699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.585453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:54.603831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0e595-5545-4ece-a0db-d6cf7a03bf85 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.609175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae8a05-3be6-4274-a900-49d8d3bc5cf4 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:54.609974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.611344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.611928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.612383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] PATH_INFO: `/v3/projects/51371f53aa594df9a9e73d4d1f37af6c/users/5b368d3c2ad5415b9f29e0dce8621830/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.614781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51371f53aa594df9a9e73d4d1f37af6c, user_id=5b368d3c2ad5415b9f29e0dce8621830, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.618230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.619526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:54.620281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:54.620637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:54.621022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:54.621856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:54.625008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:54.652875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1084/2153] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:54 2022] PUT /identity/v3/projects/51371f53aa594df9a9e73d4d1f37af6c/users/5b368d3c2ad5415b9f29e0dce8621830/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:17:54.788942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1070/2154] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:54 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:17:54.791566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:55.005187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4622a91-dfd9-46ee-9bf5-209bda29fe35 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:55.191745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:55.196056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:55.196056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:55.197214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:55.198321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:55.205176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:55.340360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1085/2155] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:54 2022] POST /identity/v3/users => generated 287 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:55.344363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:55.361942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5809a-4bbd-4b8e-944a-c3ce659a30cc admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:55.374172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:55.376116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:55.376436 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:55.376739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:55.377537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:55.380018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:55.410691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1071/2156] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:55.415815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:55.445659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8c85-86b8-43eb-8ded-15235614df7e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:55.487678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:55.510826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:55.516083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:55.516083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:55.516083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:55.523598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fef8b5-13e7-4d2b-8b30-b5775d5756d0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:55.550258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1086/2157] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:55.553601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:55.571077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36582cd-35cc-4d21-b930-7c83cb0e02ee admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:55.596098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:55.597522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:55.598078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:55.598714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] PATH_INFO: `/v3/projects/402d47b595c942c99fcbfc2881b46fd3/users/039fe12ca1f2424d9103cec96f79686b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:55.665797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=402d47b595c942c99fcbfc2881b46fd3, user_id=039fe12ca1f2424d9103cec96f79686b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:55.677035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:55.760763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1072/2158] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:55 2022] PUT /identity/v3/projects/402d47b595c942c99fcbfc2881b46fd3/users/039fe12ca1f2424d9103cec96f79686b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:55.777238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:55.777837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:55.778024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:55.869928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] MFA Rules not processed for user `039fe12ca1f2424d9103cec96f79686b`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:55.871532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:56.110125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1087/2159] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:56.110744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:56.256756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c720b-b689-4fbf-8438-f9fbaadb7f5f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:56.263518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:56.264296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:56.264626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:56.264917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:56.265649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:56.269078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:56.432477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1073/2160] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:56 2022] POST /identity/v3/projects => generated 371 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:56.437090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:56.449137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:56.491249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5075e-2faa-450b-bebf-28440d786146 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:56.657932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:56.658788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:56.660541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:56.660541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:56.660541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:56.682793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:56.815966 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:56.823626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1088/2161] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:56 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:56.827663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:56.858814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2210a-2b20-4ffa-b2a7-d61c31c19de6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:56.873799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:56.875169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:56.875169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:56.875169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:56.876908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:56.878759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:56.922238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1074/2162] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:56.932655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:56.952341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226384e-c74e-44f4-be72-f089cc8e9f06 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:56.976732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:56.978028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:56.978482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:56.978915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] PATH_INFO: `/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1/users/8e69cdcf5eac47b7b3172b080b3b6f45/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:57.021711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc2fbd9530549d796c79d0400e5dfb1, user_id=8e69cdcf5eac47b7b3172b080b3b6f45, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:57.026133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:57.136071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1089/2163] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:56 2022] PUT /identity/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1/users/8e69cdcf5eac47b7b3172b080b3b6f45/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:57.145163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:57.161736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99660-0467-43bc-95f6-6e6e3854f4a2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:57.270542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:57.271245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:57.271532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:57.271809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:57.274174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:57.275867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632f9f-5ad1-491f-9761-86768080043e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:57.310166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1075/2164] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:57.313023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:57.328199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca511c8-640d-4594-b398-3d6f8c5b29cc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:57.346341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:57.346341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:57.346341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:57.346341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] PATH_INFO: `/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1/users/8e69cdcf5eac47b7b3172b080b3b6f45/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:57.347097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc2fbd9530549d796c79d0400e5dfb1, user_id=8e69cdcf5eac47b7b3172b080b3b6f45, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:57.354846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:57.404775 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1090/2165] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:57 2022] PUT /identity/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1/users/8e69cdcf5eac47b7b3172b080b3b6f45/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:57.415477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:57.415782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:57.416085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:57.480393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] MFA Rules not processed for user `8e69cdcf5eac47b7b3172b080b3b6f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:57.482572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:57.812116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1076/2166] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:57.814684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:57.814684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:57.814684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c842d-c3b9-4bce-93ee-f951d1f44d51 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:57.819173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:57.820341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:57.820802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:57.821243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:57.836157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:57.838470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f3957-ad57-4fe2-8c90-b9accd88babb service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:57.851554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1091/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:59.574891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:59.644611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:59.661865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:59.676922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b7b1-25fd-44b5-878a-3645afb98390 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:59.687403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:59.688322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:59.690066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:59.690602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] PATH_INFO: `/v3/users/039fe12ca1f2424d9103cec96f79686b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:59.692510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=039fe12ca1f2424d9103cec96f79686b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:59.696265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:00.012834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039fe12ca1f2424d9103cec96f79686b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:00.027178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039fe12ca1f2424d9103cec96f79686b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:00.028302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039fe12ca1f2424d9103cec96f79686b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:00.054913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039fe12ca1f2424d9103cec96f79686b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:00.157806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039fe12ca1f2424d9103cec96f79686b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:00.166324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1077/2168] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:59 2022] DELETE /identity/v3/users/039fe12ca1f2424d9103cec96f79686b => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:00.171120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:00.171412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:00.171687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:00.192371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:00.193653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:00.279704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1092/2169] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:00.315410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:00.328936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:00.423741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073755e7-41f9-4d75-a0ca-9b12fdb4c619 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:00.432019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:00.432995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:00.433492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:00.433962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:00.450772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:00.452914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:00.470643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1078/2170] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:01.733156 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:01.735046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:01.748036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0932-e8a1-44d6-a473-674100cccc10 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:01.754324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:01.755586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:01.756452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:01.756452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] PATH_INFO: `/v3/projects/402d47b595c942c99fcbfc2881b46fd3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:01.758140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=402d47b595c942c99fcbfc2881b46fd3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:01.760417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:01.936274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402d47b595c942c99fcbfc2881b46fd3', 'request_id': 'req-c2196524-9374-4e65-bf6e-789f9c0f73dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:01.942801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402d47b595c942c99fcbfc2881b46fd3', 'request_id': 'req-c2196524-9374-4e65-bf6e-789f9c0f73dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:01.958628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:02.067273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402d47b595c942c99fcbfc2881b46fd3', 'request_id': 'req-c2196524-9374-4e65-bf6e-789f9c0f73dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.092300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] The token cache is being invalidate because project 402d47b595c942c99fcbfc2881b46fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:02.092703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.093608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.096945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1093/2171] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:01 2022] DELETE /identity/v3/projects/402d47b595c942c99fcbfc2881b46fd3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:02.099526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:02.112608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104630f-3ad7-4107-8d8c-47328a232d4f service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:02.222018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:02.223263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:02.223653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:02.224034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] PATH_INFO: `/v3/users/8e69cdcf5eac47b7b3172b080b3b6f45` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:02.225930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e69cdcf5eac47b7b3172b080b3b6f45)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:02.228573 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:02.231960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:02.406551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:02.408233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:02.429379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2196524-9374-4e65-bf6e-789f9c0f73dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:02.442360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:02.446443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:02.447669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:02.448121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] PATH_INFO: `/v3/users/75f4c2af9fdb4d1995bdf304b76a239d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:02.450631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f4c2af9fdb4d1995bdf304b76a239d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:02.452945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:02.506528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e69cdcf5eac47b7b3172b080b3b6f45'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.512328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e69cdcf5eac47b7b3172b080b3b6f45'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.513145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e69cdcf5eac47b7b3172b080b3b6f45'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.526943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e69cdcf5eac47b7b3172b080b3b6f45'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.656154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95758d90-0877-4de3-a041-b411414ee877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e69cdcf5eac47b7b3172b080b3b6f45'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.667816 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1079/2172] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:02 2022] DELETE /identity/v3/users/8e69cdcf5eac47b7b3172b080b3b6f45 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:02.718944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f4c2af9fdb4d1995bdf304b76a239d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.719717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f4c2af9fdb4d1995bdf304b76a239d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.737286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f4c2af9fdb4d1995bdf304b76a239d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.765917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f4c2af9fdb4d1995bdf304b76a239d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.849180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f4c2af9fdb4d1995bdf304b76a239d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:02.858103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1094/2173] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:02 2022] DELETE /identity/v3/users/75f4c2af9fdb4d1995bdf304b76a239d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:02.863236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eda55-0875-4231-9705-66f2b9f1be34 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:02.863534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eda55-0875-4231-9705-66f2b9f1be34 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:02.863822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eda55-0875-4231-9705-66f2b9f1be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:02.916828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-994eda55-0875-4231-9705-66f2b9f1be34 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:02.922143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-994eda55-0875-4231-9705-66f2b9f1be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:03.034967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1080/2174] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:03.073286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:03.080870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:03.312163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a618e-1beb-4e96-a726-2ea8bb18b145 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:03.316803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:03.317848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:03.318524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:03.319007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:03.332795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:03.340842 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:03.363372 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1095/2175] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:03.647335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783fb5-0d53-432e-928c-52478329fcd1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:03.648583 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783fb5-0d53-432e-928c-52478329fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:03.648871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783fb5-0d53-432e-928c-52478329fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:03.672190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9e783fb5-0d53-432e-928c-52478329fcd1 None None] MFA Rules not processed for user `658611df52f34f87a074a3467a42d4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:03.673712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9e783fb5-0d53-432e-928c-52478329fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:03.798639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1081/2176] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:03.963653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:03.966214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:03.990183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521108c-f7dc-4721-81c9-8859c71ce1ee service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:04.003515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:04.006733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:04.006733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:04.006733 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] PATH_INFO: `/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:04.012936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc2fbd9530549d796c79d0400e5dfb1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:04.015652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:04.183537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc2fbd9530549d796c79d0400e5dfb1', 'request_id': 'req-aa8e5c56-533b-4baf-bf22-cd03feb057e1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:04.192949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc2fbd9530549d796c79d0400e5dfb1', 'request_id': 'req-aa8e5c56-533b-4baf-bf22-cd03feb057e1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:04.278606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc2fbd9530549d796c79d0400e5dfb1', 'request_id': 'req-aa8e5c56-533b-4baf-bf22-cd03feb057e1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:04.296666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] The token cache is being invalidate because project 0dc2fbd9530549d796c79d0400e5dfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:04.296964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:04.298602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa8e5c56-533b-4baf-bf22-cd03feb057e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:04.306179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1096/2177] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:03 2022] DELETE /identity/v3/projects/0dc2fbd9530549d796c79d0400e5dfb1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:04.311402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:04.311694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:04.311975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:04.348704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:04.350227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:04.490571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1082/2178] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:04.498930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:04.499290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:04.499596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:04.539163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:04.541268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:04.552611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1097/2179] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:04.556762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:04.570294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fbda-ca17-4c4f-a855-20bf8b8f0784 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:04.591333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:04.592719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:04.592719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:04.592968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:04.593721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:04.594030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:04.596539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:04.619107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1083/2180] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:18:04.623148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:04.650579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f37b-6259-438b-a24a-79267668c61d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:04.671396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:04.672078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:04.672363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:04.672639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:04.673339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:04.675488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:04.815735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1098/2181] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:04 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:04.820914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:04.843658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37055-fc59-4a04-93fa-241ee091999d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.030198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.030895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.031178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.031639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.032503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.034678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:05.170021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1084/2182] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:04 2022] POST /identity/v3/users => generated 291 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:05.171483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:05.188664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5da44-eb41-4549-8af1-71d845df130b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.201112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.202228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.203037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.203348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.204118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.205792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:05.223041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1099/2183] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:18:05.227839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:05.248654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0f1e0-37de-4f25-a4ab-7e2a644657db admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.261246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.262214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.262894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.263379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.264373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.266390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:05.310635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1085/2184] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:05.317291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:05.337537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:05.350071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9532-5a4e-4831-aa03-002bfdb45316 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.367173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.368992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.369496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.369978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] PATH_INFO: `/v3/projects/79bde3053fc749d28c2fee4de551b871/users/bc20311a4ee64f0784c6045302ff9015/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.401315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:05.404189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:05.405914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:05.406943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bde3053fc749d28c2fee4de551b871, user_id=bc20311a4ee64f0784c6045302ff9015, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.420936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ad74-67d8-441e-8b28-137f7944104b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:05.427170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228eef-c669-4cd6-8c87-09226c439485 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.434054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.435207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.435731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.436870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] PATH_INFO: `/v3/projects/a30aea062bf24c7287848b3200629bd9` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.438650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30aea062bf24c7287848b3200629bd9)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.440896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:05.575423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1100/2185] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:05 2022] PUT /identity/v3/projects/79bde3053fc749d28c2fee4de551b871/users/bc20311a4ee64f0784c6045302ff9015/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:18:05.577647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.578727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.579222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.645161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] MFA Rules not processed for user `bc20311a4ee64f0784c6045302ff9015`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:05.655851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:05.669374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30aea062bf24c7287848b3200629bd9', 'request_id': 'req-260ba5e3-fc89-49b2-8910-472e4376e925'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:05.682937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30aea062bf24c7287848b3200629bd9', 'request_id': 'req-260ba5e3-fc89-49b2-8910-472e4376e925'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:05.774813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1101/2186] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:05.779477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:05.811167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30aea062bf24c7287848b3200629bd9', 'request_id': 'req-260ba5e3-fc89-49b2-8910-472e4376e925'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:05.836794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] The token cache is being invalidate because project a30aea062bf24c7287848b3200629bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:05.837447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:05.842451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:05.846379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1086/2187] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:05 2022] DELETE /identity/v3/projects/a30aea062bf24c7287848b3200629bd9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:05.914149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b831dc-c854-43cd-9e0e-64838c7661db None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:05.930351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:05.931229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:05.931617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:05.932007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:05.932873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:05.937458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.124433 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1102/2188] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:05 2022] POST /identity/v3/projects => generated 379 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:06.129225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.130722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:06.158875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ba5e3-fc89-49b2-8910-472e4376e925 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:06.290162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:06.291047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.291497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.292375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.293352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:06.295704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.388144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1087/2189] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:06 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:06.392859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.423159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da6a4-09f9-48d6-9102-f38c22f52406 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:06.445532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:06.445532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.445532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.445532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.446413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:06.450522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802eacc-92ad-424b-884f-ffd3c669fda5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.479671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1103/2190] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:06.484906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.534399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcff102-d297-4edf-ac85-19b85878f396 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:06.540318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:06.541237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.541636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.541923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] PATH_INFO: `/v3/projects/2054a2abca1c48aa94ffb249b7464a84/users/77ead72dd6314e7fb2cadcd84c99fbc7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.576000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2054a2abca1c48aa94ffb249b7464a84, user_id=77ead72dd6314e7fb2cadcd84c99fbc7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:06.576724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.660050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.660400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.665982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.690191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] MFA Rules not processed for user `5b368d3c2ad5415b9f29e0dce8621830`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:06.691455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:06.714829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1088/2191] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:06 2022] PUT /identity/v3/projects/2054a2abca1c48aa94ffb249b7464a84/users/77ead72dd6314e7fb2cadcd84c99fbc7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:06.718464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.859861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d884-c4fc-4a75-af34-f19f03a3fe05 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:06.870514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:06.871221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.871513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.871794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.872543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:06.877842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.888707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1104/2192] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:06.900780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.904181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1089/2193] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:18:06.905773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:06.910159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:06.920674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba860-1545-4963-aa65-00d9a1b53c4c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:06.926813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:06.929700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.929700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.929700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] PATH_INFO: `/v3/projects/2054a2abca1c48aa94ffb249b7464a84/users/77ead72dd6314e7fb2cadcd84c99fbc7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.931812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2054a2abca1c48aa94ffb249b7464a84, user_id=77ead72dd6314e7fb2cadcd84c99fbc7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:06.934891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632034e-ba2d-45f0-836d-c82d6c03b4c8 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:06.948591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1090/2194] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:06 2022] PUT /identity/v3/projects/2054a2abca1c48aa94ffb249b7464a84/users/77ead72dd6314e7fb2cadcd84c99fbc7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:06.960962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:06.961367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:06.961963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:06.995296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] MFA Rules not processed for user `77ead72dd6314e7fb2cadcd84c99fbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:06.996651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:07.026411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c030d-0bc5-4b4c-bb3c-c0e1c0607f44 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:07.094265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:07.095013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:07.095384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:07.095738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:07.097687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:07.098461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1091/2195] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:07.126844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:07.133237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:07.178320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:07.180028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b869d-c2be-41ab-910b-95a88fd05832 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:07.192277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1105/2196] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:07.238913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626ca15-3e64-4849-9d0b-0f184263ce6f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:07.243328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:07.248254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:07.248254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:07.248254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:07.255510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:07.257249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:07.269441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1092/2197] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:07.581485 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:07.582597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:07.583056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:07.610268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:07.611502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:07.737345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1106/2198] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:07.754069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:07.755402 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:07.846661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f2b60-94c9-4fb2-862d-66b1ea9d8cfe service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:07.858329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:07.858963 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:07.859242 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:07.859703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:07.871626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:07.873388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:07.888272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1093/2199] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:08.432720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:08.558169 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:08.654595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:08.672719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefd23e-1cd3-4fbf-9c57-f88214aae849 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:08.680870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ead72dd6314e7fb2cadcd84c99fbc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2054a2abca1c48aa94ffb249b7464a84', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:08.682052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:08.682398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:08.682750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:08.683569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:08.683941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:08.685703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:08.704542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1107/2200] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:18:08.709035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:08.724922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932c2e4-3e23-497a-9105-9fa7e49251ae service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:08.731601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ead72dd6314e7fb2cadcd84c99fbc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2054a2abca1c48aa94ffb249b7464a84', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:08.732479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:08.732925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:08.733419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:08.734371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:08.736700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:08.861212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1094/2201] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:08 2022] POST /identity/v3/projects => generated 354 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:08.865032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:08.884341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e09be-840c-419c-8f9c-19f4a2d55606 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:09.075418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ead72dd6314e7fb2cadcd84c99fbc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2054a2abca1c48aa94ffb249b7464a84', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:09.078383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:09.078383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:09.078383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:09.078383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:09.078383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:09.080783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:09.114030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1108/2202] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:18:09.254201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:09.302395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94734-9dbe-4191-be62-077065a3ea66 tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:09.312716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ead72dd6314e7fb2cadcd84c99fbc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2054a2abca1c48aa94ffb249b7464a84', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:09.330417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:09.330417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:09.330417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] PATH_INFO: `/v3/projects/7ac6aff2b7a048748d3bb92d3e693a29` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:09.330417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ac6aff2b7a048748d3bb92d3e693a29)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:09.330923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:09.725036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac6aff2b7a048748d3bb92d3e693a29', 'request_id': 'req-2a34701d-9261-4641-81dc-8914fe7045aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:09.751826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac6aff2b7a048748d3bb92d3e693a29', 'request_id': 'req-2a34701d-9261-4641-81dc-8914fe7045aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:09.912569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac6aff2b7a048748d3bb92d3e693a29', 'request_id': 'req-2a34701d-9261-4641-81dc-8914fe7045aa'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:09.922939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] The token cache is being invalidate because project 7ac6aff2b7a048748d3bb92d3e693a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:09.923249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:09.938119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a34701d-9261-4641-81dc-8914fe7045aa tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:09.944397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1095/2203] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:09 2022] DELETE /identity/v3/projects/7ac6aff2b7a048748d3bb92d3e693a29 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:11.174053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:11.176296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:11.418200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f01e6-c2eb-4903-b84f-ab14b5c675bd tempest-VolumeQuotaClassesTest-607017968 tempest-VolumeQuotaClassesTest-607017968-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:11.559211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:11.560113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:11.560399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:11.560678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] PATH_INFO: `/v3/users/bc20311a4ee64f0784c6045302ff9015` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:11.562116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc20311a4ee64f0784c6045302ff9015)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:11.564113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:11.909751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc20311a4ee64f0784c6045302ff9015'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:11.910218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc20311a4ee64f0784c6045302ff9015'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:11.936915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc20311a4ee64f0784c6045302ff9015'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:11.969153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc20311a4ee64f0784c6045302ff9015'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:12.255511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1ac5d5a2-c8be-4930-83dc-f3d76d0321eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc20311a4ee64f0784c6045302ff9015'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:12.274744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1109/2204] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:11 2022] DELETE /identity/v3/users/bc20311a4ee64f0784c6045302ff9015 => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:12.279210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:12.280113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:12.280561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:12.315669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:12.317006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:12.554772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:12.557382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:12.557382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:12.579114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1096/2205] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:12.615100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:12.615100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:12.642359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:12.645497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:12.724143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:12.756567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525973-52a9-430b-a41b-17cf1c991f9f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:12.805290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:12.805290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:12.805290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:12.805290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:12.807611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:12.807611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:12.828300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1097/2206] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:13.030834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1110/2207] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:13.031155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:13.031155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:13.047317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87307-41d8-4c46-99cd-574376ca3f2e service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:13.058437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:13.059635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:13.059936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:13.060190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:13.071133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:13.072851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:13.088932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1098/2208] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:13.632879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:14.242889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:14.244396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:14.276199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05da0-7761-4cdc-9428-627c7c39320c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:14.286578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:14.287831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:14.288260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:14.288663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] PATH_INFO: `/v3/projects/79bde3053fc749d28c2fee4de551b871` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:14.290233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bde3053fc749d28c2fee4de551b871)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:14.292464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:14.552265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bde3053fc749d28c2fee4de551b871', 'request_id': 'req-72cf7fcd-4c3e-4043-8623-530f35cbd84d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:14.567180 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bde3053fc749d28c2fee4de551b871', 'request_id': 'req-72cf7fcd-4c3e-4043-8623-530f35cbd84d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:14.655313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bde3053fc749d28c2fee4de551b871', 'request_id': 'req-72cf7fcd-4c3e-4043-8623-530f35cbd84d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:14.692659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] The token cache is being invalidate because project 79bde3053fc749d28c2fee4de551b871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:14.693319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:14.696246 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:14.698405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1111/2209] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:14 2022] DELETE /identity/v3/projects/79bde3053fc749d28c2fee4de551b871 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:14.702589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:14.717800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff959-e820-4ab4-971a-257bc2fd9b94 service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:14.880530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:14.881738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:14.883040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:14.883040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] PATH_INFO: `/v3/users/77ead72dd6314e7fb2cadcd84c99fbc7` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:14.883697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ead72dd6314e7fb2cadcd84c99fbc7)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:14.887331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:15.341218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:15.426484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ead72dd6314e7fb2cadcd84c99fbc7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:15.433649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:15.457832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ead72dd6314e7fb2cadcd84c99fbc7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:15.459468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ead72dd6314e7fb2cadcd84c99fbc7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:15.511466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ead72dd6314e7fb2cadcd84c99fbc7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:15.620767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-121b9e17-a0f1-4977-b9b1-989370fa9064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ead72dd6314e7fb2cadcd84c99fbc7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:15.636801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1099/2210] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:14 2022] DELETE /identity/v3/users/77ead72dd6314e7fb2cadcd84c99fbc7 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:15.861203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:17.134295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:17.134295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:17.157257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7fcd-4c3e-4043-8623-530f35cbd84d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:17.293171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:17.294201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:17.294563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:17.295213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] PATH_INFO: `/v3/projects/2054a2abca1c48aa94ffb249b7464a84` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:17.298548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2054a2abca1c48aa94ffb249b7464a84)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:17.300797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:17.600601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2054a2abca1c48aa94ffb249b7464a84', 'request_id': 'req-2e5a4412-7ed2-464c-b42c-e20d0d051585'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:17.619207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2054a2abca1c48aa94ffb249b7464a84', 'request_id': 'req-2e5a4412-7ed2-464c-b42c-e20d0d051585'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:18.135347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2054a2abca1c48aa94ffb249b7464a84', 'request_id': 'req-2e5a4412-7ed2-464c-b42c-e20d0d051585'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:18.161398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] The token cache is being invalidate because project 2054a2abca1c48aa94ffb249b7464a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:18.162493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:18.164402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e5a4412-7ed2-464c-b42c-e20d0d051585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:18.167705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1112/2211] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:17 2022] DELETE /identity/v3/projects/2054a2abca1c48aa94ffb249b7464a84 => generated 0 bytes in 1070 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:18.172986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.174881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.175405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.201002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:18.203214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:18.267377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:18.327698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1100/2212] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:18.329321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.329814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.330345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.366168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:18.368537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:18.391061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:18.395846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1113/2213] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:18.402145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50118-7767-4d50-ae82-9d01631583c2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:18.409819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:18.411295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.411744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.412069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.412954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:18.413619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:18.416069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:18.436688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1101/2214] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:18:18.447309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:18.460579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901cb6-59dc-424c-a8ff-280401c8b4fd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:18.471394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:18.472900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.474332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.475166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.476217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:18.479734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:18.644000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1114/2215] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:18 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:18.646104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:18.713762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c18f82-00bd-40a5-b17e-80e01609ceb7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:18.919844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:18.920787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.921124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.921409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.923037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:18.925215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:19.253013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1102/2216] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:18 2022] POST /identity/v3/users => generated 293 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:19.254456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:19.268457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c39749-081f-4236-83dc-84ac58f41bf3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:19.277521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:19.278476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:19.278944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:19.279221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:19.279965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:19.281826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:19.298670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1115/2217] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:18:19.300585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:19.314606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c39a-3aea-4e96-afa5-350b168ff729 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:19.319689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:19.320450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:19.320820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:19.321156 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:19.322022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:19.323767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae8c98-69cd-4fbe-b77c-97fc96d2711b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:19.347772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:19.347915 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1103/2218] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:19.363757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3821c-b923-485e-85ee-c599aaa8b18b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:19.370804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:19.372273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:19.374622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:19.375990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] PATH_INFO: `/v3/projects/f7be0bc9f20d40978ea4bad1317b0f45/users/4ce50c993d85471bad488a192a738178/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:19.380393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:19.396300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7be0bc9f20d40978ea4bad1317b0f45, user_id=4ce50c993d85471bad488a192a738178, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:19.400079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:19.517208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1116/2219] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:19 2022] PUT /identity/v3/projects/f7be0bc9f20d40978ea4bad1317b0f45/users/4ce50c993d85471bad488a192a738178/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:19.533151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:19.533408 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:19.534393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:19.606716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] MFA Rules not processed for user `4ce50c993d85471bad488a192a738178`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:19.609214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:19.857262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1104/2220] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:19.861596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:20.005034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fd3cd-d717-404f-94d6-aff17a3e4640 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:20.038936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:20.048530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:20.048530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:20.048530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:20.048530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:20.048530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:20.275046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1117/2221] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:19 2022] POST /identity/v3/projects => generated 387 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:20.280392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:20.302744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4a6b-c380-48cf-b359-7c278c74d9cf None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:20.586635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:20.587952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:20.588247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:20.588531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:20.589260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:20.591282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:20.719243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1105/2222] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:20 2022] POST /identity/v3/users => generated 294 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:20.723097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:20.752355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1df6-45e8-4936-8f24-eba945074291 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:20.761303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:20.762453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:20.763024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:20.763539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:20.764588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:20.766629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:20.800045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1118/2223] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:20.804364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:20.821810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6ae0-996a-4525-9902-b9ae1c0ae5a6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:20.838748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:20.839920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:20.840442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:20.840942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:20.842249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:20.844407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184d8b-92b9-4788-984a-4d43d7a34a69 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:20.871926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1106/2224] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:20.875960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:20.892620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd36ba-6952-410d-b413-89ac79d1f8e6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:20.907656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:20.909482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:20.911050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:20.911601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] PATH_INFO: `/v3/projects/b8ca89fa1cf3480886ee09b9fec133fa/users/0dd857938f4c419da54d5b9ffc71599b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:20.949771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ca89fa1cf3480886ee09b9fec133fa, user_id=0dd857938f4c419da54d5b9ffc71599b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:20.953153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:20.975817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:21.058497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1119/2225] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:20 2022] PUT /identity/v3/projects/b8ca89fa1cf3480886ee09b9fec133fa/users/0dd857938f4c419da54d5b9ffc71599b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:21.068903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:21.070528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:21.071503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:21.155727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] MFA Rules not processed for user `0dd857938f4c419da54d5b9ffc71599b`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:21.159886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:21.323261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1107/2226] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:21.328111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:21.455563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f6244-b36b-4166-a379-2a5521ae12a1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:21.486342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:21.487396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:21.487778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:21.488337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:21.489171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:21.492439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:21.657086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1120/2227] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:21 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:21.661514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:21.690961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08b68-5d4a-4477-b5df-e36529e688d4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:21.907529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:21.908140 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:21.908422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:21.908699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:21.909687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:21.911544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.016827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1108/2228] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:21 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:18:22.020865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:22.048559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46cc76-a9ac-4e56-a70a-0bf31ff94c75 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:22.079624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:22.080641 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.083239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.083954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.090203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:22.093406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.117561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1121/2229] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:22.121522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:22.130969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:22.142976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6efe-ad08-4542-afcf-3fd5c4c2daa3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:22.170603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:22.171613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.171900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.172177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] PATH_INFO: `/v3/projects/e63499aee5e047f9b496e1b78495b015/users/b1b8055ad4bb4b60803d43644e4851cb/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.216170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63499aee5e047f9b496e1b78495b015, user_id=b1b8055ad4bb4b60803d43644e4851cb, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:22.224425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.337872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1109/2230] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:22 2022] PUT /identity/v3/projects/e63499aee5e047f9b496e1b78495b015/users/b1b8055ad4bb4b60803d43644e4851cb/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:22.342861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:22.391062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a52a4-7088-49c4-8a17-61c90a699103 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:22.428122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:22.663015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:22.663015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.663015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.663015 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.665723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:22.665723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfbdfc-8f1e-4464-827d-7eaaeab93f35 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.665723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1122/2231] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:22.667015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:22.688233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237f7f-7cf9-4154-bfc9-15b148f15c29 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:22.749820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:22.751517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.751988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.752447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] PATH_INFO: `/v3/projects/e63499aee5e047f9b496e1b78495b015/users/b1b8055ad4bb4b60803d43644e4851cb/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.755013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63499aee5e047f9b496e1b78495b015, user_id=b1b8055ad4bb4b60803d43644e4851cb, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:22.770397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.818689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1110/2232] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:22 2022] PUT /identity/v3/projects/e63499aee5e047f9b496e1b78495b015/users/b1b8055ad4bb4b60803d43644e4851cb/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:22.833071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.833359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.834027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.894990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] MFA Rules not processed for user `b1b8055ad4bb4b60803d43644e4851cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:22.896541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:23.058100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1123/2233] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:23.078406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:23.081857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:23.238988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2b7e-2692-4a8e-b383-fb97bfafb7b3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:23.244175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:23.245014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:23.245305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:23.245617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:23.254813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:23.269308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:23.271896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a51ec-f7d7-423e-86c3-a24fb2168da9 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:23.287266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1111/2234] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:25.691161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:25.706863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845220c2-7bfe-4e34-9656-a1c70ba6e66c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:25.729261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:25.741781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:25.741781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:25.741781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:25.902978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:25.904734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b09775-5b99-4b07-9018-a0057bb0574e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:25.926367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1124/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:25.995038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:25.996155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:25.996619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:26.031903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] MFA Rules not processed for user `381ef8fa6a804a08a85ed19503c12daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:26.035940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:26.192099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1112/2236] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:27.463439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:27.465550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:27.465550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:27.516921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:27.532933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:27.612268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:27.666942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1125/2237] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:27.685932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:27.689833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:27.845976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19d275-d5b3-46b8-a478-de7ba714b267 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:27.852578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:27.853870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:27.854347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:27.854894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:27.880218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:27.880218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95e663-2b0e-4820-abf3-7cef4b765cba service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:27.893302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1113/2238] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:33.275215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:33.348835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b7388-4884-464e-90c5-d53ece568645 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:33.368875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:33.369960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:33.370430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:33.370996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:33.547124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:33.549987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:33.564325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1126/2239] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:34.222106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:34.222959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:34.223426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:34.267080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:34.274221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:34.306904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1114/2240] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:34.343722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:34.364328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2997-bdbb-44ff-936e-0887fd32425b service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:34.377757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:34.378966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:34.379373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:34.380016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:34.395079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:34.398084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:34.414809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1127/2241] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:39.521170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:39.776870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974f3f0-983d-4cdc-9f65-6470e26340a1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:39.776870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:39.776870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:39.776870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:39.777884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] PATH_INFO: `/v3/users/4ce50c993d85471bad488a192a738178` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:39.777884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce50c993d85471bad488a192a738178)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:39.777884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:39.840141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:40.099526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce50c993d85471bad488a192a738178'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:40.147586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce50c993d85471bad488a192a738178'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:40.152667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce50c993d85471bad488a192a738178'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:40.237081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce50c993d85471bad488a192a738178'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:40.353635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:40.361443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-62d1553a-2a40-4d16-95b3-6bd6b3efd55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce50c993d85471bad488a192a738178'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:40.367696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:40.417332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1115/2242] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:39 2022] DELETE /identity/v3/users/4ce50c993d85471bad488a192a738178 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:40.425856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:40.426292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:40.426603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:40.511189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:40.517840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:40.582984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a521a0-b78b-40b4-9e74-cc2c59f90667 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:40.852890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1116/2243] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:40.853847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:40.853847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:40.853847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:40.853847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:40.854473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:40.854473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:40.854473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:40.854473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:40.854473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1128/2244] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:40.863050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:40.865327 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:41.051542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ccd5-5169-4548-9844-eecb8bcf576a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:41.057139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:41.057999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:41.058308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:41.058675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:41.069468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:41.071089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:41.081758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1117/2245] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:42.390589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:42.392112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:42.429820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e191d-6836-411c-b245-c58790242c33 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:42.439129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:42.440359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:42.441564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:42.442114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] PATH_INFO: `/v3/projects/f7be0bc9f20d40978ea4bad1317b0f45` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:42.445410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7be0bc9f20d40978ea4bad1317b0f45)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:42.450651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:42.599684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7be0bc9f20d40978ea4bad1317b0f45', 'request_id': 'req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:42.614211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7be0bc9f20d40978ea4bad1317b0f45', 'request_id': 'req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:42.701445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7be0bc9f20d40978ea4bad1317b0f45', 'request_id': 'req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:42.730717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] The token cache is being invalidate because project f7be0bc9f20d40978ea4bad1317b0f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:42.738096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:42.739275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:42.746810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1129/2246] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:42 2022] DELETE /identity/v3/projects/f7be0bc9f20d40978ea4bad1317b0f45 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:42.748415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:42.767086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441c4e-9064-4715-92a2-094d24c56853 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:42.897146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:42.951535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:42.952447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:42.952779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:42.953056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] PATH_INFO: `/v3/users/0dd857938f4c419da54d5b9ffc71599b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:42.954375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd857938f4c419da54d5b9ffc71599b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:42.958401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:43.286948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd857938f4c419da54d5b9ffc71599b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:43.306893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd857938f4c419da54d5b9ffc71599b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:43.307856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd857938f4c419da54d5b9ffc71599b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:43.346747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd857938f4c419da54d5b9ffc71599b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:43.438662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd857938f4c419da54d5b9ffc71599b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:43.449990 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1118/2247] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:42 2022] DELETE /identity/v3/users/0dd857938f4c419da54d5b9ffc71599b => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:44.721287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:44.725346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:44.747354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb41f6-797e-4e08-9360-82cf09a8f6a9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:44.986172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:45.029063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:45.029063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:45.029063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] PATH_INFO: `/v3/projects/b8ca89fa1cf3480886ee09b9fec133fa` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:45.029063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ca89fa1cf3480886ee09b9fec133fa)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:45.029063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:45.466598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ca89fa1cf3480886ee09b9fec133fa', 'request_id': 'req-54197bd4-93bc-4489-97a6-e34049bf916e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.475185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ca89fa1cf3480886ee09b9fec133fa', 'request_id': 'req-54197bd4-93bc-4489-97a6-e34049bf916e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.570507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ca89fa1cf3480886ee09b9fec133fa', 'request_id': 'req-54197bd4-93bc-4489-97a6-e34049bf916e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.591578 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] The token cache is being invalidate because project b8ca89fa1cf3480886ee09b9fec133fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:45.591976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.592779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54197bd4-93bc-4489-97a6-e34049bf916e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.596744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1130/2248] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:44 2022] DELETE /identity/v3/projects/b8ca89fa1cf3480886ee09b9fec133fa => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:45.600434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:45.602529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:45.620899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94941e-3b81-4635-9100-604f85d36126 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:45.701312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:45.702182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:45.702465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:45.702745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] PATH_INFO: `/v3/users/b1b8055ad4bb4b60803d43644e4851cb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:45.706657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b8055ad4bb4b60803d43644e4851cb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:45.708411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:45.728747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7fff-3cb7-4b15-a296-9c7b565c6959 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:45.729318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7fff-3cb7-4b15-a296-9c7b565c6959 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:45.729491 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d7fff-3cb7-4b15-a296-9c7b565c6959 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:45.731174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1131/2249] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:18:45.752065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:45.752065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:45.754634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:45.779339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:45.839238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:45.842749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:45.937722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b8055ad4bb4b60803d43644e4851cb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.952489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b8055ad4bb4b60803d43644e4851cb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.953834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b8055ad4bb4b60803d43644e4851cb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:45.976245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:45.988279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b8055ad4bb4b60803d43644e4851cb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:46.045899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1132/2250] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:46.064318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-28bd49c9-73ea-40fb-af7f-7cd466e167f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b8055ad4bb4b60803d43644e4851cb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:46.078927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1119/2251] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:45 2022] DELETE /identity/v3/users/b1b8055ad4bb4b60803d43644e4851cb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:46.848521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:46.850128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:46.875746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1e632-b5cd-4121-b883-6b54a69954c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:47.009856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:47.011083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.011496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.011855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] PATH_INFO: `/v3/projects/e63499aee5e047f9b496e1b78495b015` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.013240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63499aee5e047f9b496e1b78495b015)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:47.015483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:47.174430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63499aee5e047f9b496e1b78495b015', 'request_id': 'req-d1cee3b5-6864-4667-b9b4-04f227e49561'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:47.190227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63499aee5e047f9b496e1b78495b015', 'request_id': 'req-d1cee3b5-6864-4667-b9b4-04f227e49561'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:47.301984 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63499aee5e047f9b496e1b78495b015', 'request_id': 'req-d1cee3b5-6864-4667-b9b4-04f227e49561'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:47.326227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] The token cache is being invalidate because project e63499aee5e047f9b496e1b78495b015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:47.326227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:47.329183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d1cee3b5-6864-4667-b9b4-04f227e49561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:47.344597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1133/2252] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:46 2022] DELETE /identity/v3/projects/e63499aee5e047f9b496e1b78495b015 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:47.344810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.344810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.344810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.377498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:47.378806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:47.522287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1120/2253] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:47.523957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.524411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.524808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.564876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:47.566260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:47.582663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:47.593358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1134/2254] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:47.596683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669f0f-d0a7-4ba8-a410-8aac3598e041 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:47.603278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:47.604198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.604972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.604972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.605430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:47.605746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:47.607790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:47.628591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:47.636356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1121/2255] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:18:47.642268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8dea5-b80c-4b07-8d6c-f416983bac91 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:47.650211 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:47.651171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.651680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.652060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.653062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:47.655265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:47.759929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:47.772266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1135/2256] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:47 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:47.777413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:47.803123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4093f-8490-4243-8e36-5464bbf4ca44 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:47.955939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:47.957000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:47.957509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:47.957967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:47.958851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:47.962141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:48.104415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1122/2257] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:47 2022] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:48.108500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:48.161939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea56a-5f69-45e1-9815-0321363bc7a8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:48.170267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:48.174048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:48.174487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:48.174682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:48.176362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:48.178397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:48.237121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1136/2258] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:48.288557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:48.337624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045712-20e3-4ed5-9473-4eaa65e7acd8 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:48.343337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:48.344205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:48.344650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:48.344969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:48.345789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:48.347587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c2460-975f-4f2f-8597-bde19523c235 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:48.371185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1123/2259] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:48.372550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:48.383581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25671d6-dfb0-4a1d-8ac2-123f2435dd3b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:48.392706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:48.393441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:48.393832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:48.394201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] PATH_INFO: `/v3/projects/82fbc84e2ec9425790b52dbbc4477da4/users/0218b10f4375401aad5df54e5aa4c4d0/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:48.424888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fbc84e2ec9425790b52dbbc4477da4, user_id=0218b10f4375401aad5df54e5aa4c4d0, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:48.427766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:48.764983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1137/2260] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:48 2022] PUT /identity/v3/projects/82fbc84e2ec9425790b52dbbc4477da4/users/0218b10f4375401aad5df54e5aa4c4d0/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:48.776868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:48.777158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:48.777453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:48.852952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] MFA Rules not processed for user `0218b10f4375401aad5df54e5aa4c4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:48.855091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:48.964479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:49.014945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1124/2261] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:49.020173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.163184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.168289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:49.177122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd08f6-d3ab-48bb-b64c-9e9dba672ab6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.202537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.208285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.208995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.216579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.220631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.226665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.271248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7a76-da75-4588-ab2c-3a949c815a6f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.275832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.276580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.277050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.277473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.279646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:49.384729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1138/2262] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:49 2022] POST /identity/v3/projects => generated 393 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:49.405381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.406891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.421862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1125/2263] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:49.435486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.536204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7191a4-4d72-4638-8855-c264a3e60b82 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.539684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.540377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.540694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.540934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.541658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.543604 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.645387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1139/2264] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:49 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:49.650142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.661546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79fa59-1b45-4eb1-af98-903b7e4dbcc6 service glance] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.666357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.667026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.667306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.667581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.668299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.669964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4ee49-d872-4379-8056-8a79420211f1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.680652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1126/2265] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:49.685114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.696495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0500c5-9bb9-4287-8927-ca2f84aa340b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.701405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.702333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.702616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.702894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] PATH_INFO: `/v3/projects/87783765874047e28d85ffdb0903a9eb/users/80cdbfaf5bc846b59d188cc0e1ac25d5/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.735155 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] RBAC: Authorizing `identity:create_grant(project_id=87783765874047e28d85ffdb0903a9eb, user_id=80cdbfaf5bc846b59d188cc0e1ac25d5, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.737903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.743205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574f69-55d5-4293-8948-75ca6616efe0 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.743441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574f69-55d5-4293-8948-75ca6616efe0 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.743722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574f69-55d5-4293-8948-75ca6616efe0 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.745279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1127/2266] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:18:49.750522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.755673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.755673 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.780524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:49.784970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:49.860600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1140/2267] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:49 2022] PUT /identity/v3/projects/87783765874047e28d85ffdb0903a9eb/users/80cdbfaf5bc846b59d188cc0e1ac25d5/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:49.861543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.875451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1128/2268] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:49.880342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:49.888489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.890233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:49.910922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3d2d9-643d-41b5-9f4c-ea08d7fb189e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.933917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:49.948849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cfebf-f2b4-4f23-a2f6-1446bb9828df admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:49.957280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.958316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.958797 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.959818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:49.961273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:49.964149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:49.984446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1141/2269] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:18:49.988637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:49.994650 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:49.995582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:49.995968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:49.996350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.007444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.009369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296558c-5141-4d07-94aa-21da50499623 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.009736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e381-5b9a-45b1-8cbf-020b69b2aa80 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.015241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.016145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.016595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.016891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] PATH_INFO: `/v3/projects/87783765874047e28d85ffdb0903a9eb/users/80cdbfaf5bc846b59d188cc0e1ac25d5/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.019035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87783765874047e28d85ffdb0903a9eb, user_id=80cdbfaf5bc846b59d188cc0e1ac25d5, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.022954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59b3ea-d3f4-4b26-9e45-9c7e53b80dc3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.027890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1129/2270] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:50.035195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1142/2271] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:49 2022] PUT /identity/v3/projects/87783765874047e28d85ffdb0903a9eb/users/80cdbfaf5bc846b59d188cc0e1ac25d5/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:50.048330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.048624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.048939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.118976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] MFA Rules not processed for user `80cdbfaf5bc846b59d188cc0e1ac25d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:50.120251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.143403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d768-8aab-47d0-8918-5d2ff4010c46 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.143737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d768-8aab-47d0-8918-5d2ff4010c46 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.143975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70d768-8aab-47d0-8918-5d2ff4010c46 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.145359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1143/2272] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:18:50.151760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.151760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.152082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.180948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:50.182779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.280603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1130/2273] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:50.291409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.292993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.351843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1144/2274] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:50.358678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.403345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f678c-0970-4e97-9a68-adf34821e690 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.407423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.408146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.408424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.408701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.420904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.422461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.440750 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1131/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:50.466715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853e7ba-c0c5-4612-a3a5-bee2c54f1477 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.471128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.471915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.472204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.472482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.487512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.489184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9fdc-2862-44e0-824c-11d477840035 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.507777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1145/2276] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:50.529608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.531131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.543364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0be4d-92f3-45a3-8010-389dce2922cd service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.547494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.548171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.548456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.548886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.625519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:50.642792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.644345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.656421 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1132/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:52.409526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb4ef-9fa3-4e23-8794-d97c4414f3d2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:52.409526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb4ef-9fa3-4e23-8794-d97c4414f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:52.409526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb4ef-9fa3-4e23-8794-d97c4414f3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:52.409526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-231bb4ef-9fa3-4e23-8794-d97c4414f3d2 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:52.410639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-231bb4ef-9fa3-4e23-8794-d97c4414f3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:52.439656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:52.470881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1146/2278] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:52.484406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:52.485947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:52.564473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f135ed-531c-456b-b32e-3ba3c3b12d24 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:52.571578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:52.572230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:52.572513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:52.573017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:52.581776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:52.583482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:52.592071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1133/2279] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:55.272954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:55.273728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:55.274329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:55.294154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:55.295384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:55.310534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1147/2280] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:55.323375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:55.335881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32f21-31ad-41ea-854b-084bf2c2cf48 service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:55.341455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:55.342157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:55.344215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:55.344215 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:55.353404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:55.355078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:55.383173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1134/2281] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:18:56.174147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:56.175894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:56.273626 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddca1-69bb-445a-a473-fca594fedde2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:56.281799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:56.283348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:56.283864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:56.284341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] PATH_INFO: `/v3/users/8e873322c2724be084dc009402dcb4ba` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:56.286569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e873322c2724be084dc009402dcb4ba)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:56.288993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:56.537517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e873322c2724be084dc009402dcb4ba'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:56.538684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e873322c2724be084dc009402dcb4ba'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:56.551573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e873322c2724be084dc009402dcb4ba'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:56.573764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e873322c2724be084dc009402dcb4ba'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:56.707107 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e873322c2724be084dc009402dcb4ba'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:56.716322 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1148/2282] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:56 2022] DELETE /identity/v3/users/8e873322c2724be084dc009402dcb4ba => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:56.944226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:56.960086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb813a-d601-46bf-9da6-7f86419e13f8 service swift] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:57.093514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:57.094561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.094855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.095132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] PATH_INFO: `/v3/users/0218b10f4375401aad5df54e5aa4c4d0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.096721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0218b10f4375401aad5df54e5aa4c4d0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:57.099683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:57.171154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:57.173017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:57.192660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97debd2-6ee5-4fb2-a327-f691c643b678 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:57.199119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:57.200536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.200536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.200743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] PATH_INFO: `/v3/projects/acb791f8c00e4aa4aacfadf23fa87b94` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.202008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb791f8c00e4aa4aacfadf23fa87b94)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:57.203961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:57.342394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0218b10f4375401aad5df54e5aa4c4d0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.361172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0218b10f4375401aad5df54e5aa4c4d0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.361172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0218b10f4375401aad5df54e5aa4c4d0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.374325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:57.385259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0218b10f4375401aad5df54e5aa4c4d0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.394300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:57.399453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb791f8c00e4aa4aacfadf23fa87b94', 'request_id': 'req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.405826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb791f8c00e4aa4aacfadf23fa87b94', 'request_id': 'req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.491605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bc4daa82-b3e3-4725-8a83-22e25f93ce5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0218b10f4375401aad5df54e5aa4c4d0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.501283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1135/2283] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:56 2022] DELETE /identity/v3/users/0218b10f4375401aad5df54e5aa4c4d0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:57.506494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.506785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.507075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.530450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:57.531788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:57.576463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb791f8c00e4aa4aacfadf23fa87b94', 'request_id': 'req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.598159 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] The token cache is being invalidate because project acb791f8c00e4aa4aacfadf23fa87b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:57.598579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.599306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:57.601061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1149/2284] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:57 2022] DELETE /identity/v3/projects/acb791f8c00e4aa4aacfadf23fa87b94 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:57.617124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1136/2285] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:57.631794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:57.638783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:57.751181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed61d7-a5b7-476b-ab1d-af102f2f92d4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:57.846439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:57.847314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.847598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.848039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.884577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:57.888420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:57.907050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1150/2286] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:58.952647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:58.955135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:58.975787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc594-9199-4eda-afa5-70bda6fb322e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:58.981853 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:58.982788 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:58.983073 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:58.983351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] PATH_INFO: `/v3/projects/82fbc84e2ec9425790b52dbbc4477da4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:58.985616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fbc84e2ec9425790b52dbbc4477da4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:58.988123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:59.173964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fbc84e2ec9425790b52dbbc4477da4', 'request_id': 'req-25c72133-b830-4b8b-9492-d73192a63f8d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.179798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fbc84e2ec9425790b52dbbc4477da4', 'request_id': 'req-25c72133-b830-4b8b-9492-d73192a63f8d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.278935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fbc84e2ec9425790b52dbbc4477da4', 'request_id': 'req-25c72133-b830-4b8b-9492-d73192a63f8d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.292223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] The token cache is being invalidate because project 82fbc84e2ec9425790b52dbbc4477da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:59.294566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.294566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.295133 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1137/2287] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:58 2022] DELETE /identity/v3/projects/82fbc84e2ec9425790b52dbbc4477da4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:59.299210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:59.311461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80d20-1697-49ff-b46b-9e98852fad22 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:59.420874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:59.427399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:59.427399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:59.427399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] PATH_INFO: `/v3/users/80cdbfaf5bc846b59d188cc0e1ac25d5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:59.427399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cdbfaf5bc846b59d188cc0e1ac25d5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:59.427399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:59.669994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:59.684633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cdbfaf5bc846b59d188cc0e1ac25d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.685225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cdbfaf5bc846b59d188cc0e1ac25d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.693803 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cdbfaf5bc846b59d188cc0e1ac25d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.710293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cdbfaf5bc846b59d188cc0e1ac25d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.816386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ab0eb4e-411b-4961-bbca-65c85f9cf50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cdbfaf5bc846b59d188cc0e1ac25d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:59.827608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1151/2288] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:59 2022] DELETE /identity/v3/users/80cdbfaf5bc846b59d188cc0e1ac25d5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:00.414669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:00.415660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:00.461901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c72133-b830-4b8b-9492-d73192a63f8d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:00.569240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:00.570392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:00.571439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:00.571774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] PATH_INFO: `/v3/projects/87783765874047e28d85ffdb0903a9eb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:00.573245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87783765874047e28d85ffdb0903a9eb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:00.582508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:00.602810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:00.812541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87783765874047e28d85ffdb0903a9eb', 'request_id': 'req-95c18359-dc2c-4a78-a9e7-18579539e5b4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:00.819324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87783765874047e28d85ffdb0903a9eb', 'request_id': 'req-95c18359-dc2c-4a78-a9e7-18579539e5b4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:00.918791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87783765874047e28d85ffdb0903a9eb', 'request_id': 'req-95c18359-dc2c-4a78-a9e7-18579539e5b4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:00.933481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] The token cache is being invalidate because project 87783765874047e28d85ffdb0903a9eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:00.933931 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:00.934674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-95c18359-dc2c-4a78-a9e7-18579539e5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:00.936620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1138/2289] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:00 2022] DELETE /identity/v3/projects/87783765874047e28d85ffdb0903a9eb => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:00.941640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:00.942210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:00.942210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:00.990013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:00.991200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:01.109676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.110052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.110429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.113967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1152/2290] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:19:01.145921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:01.147186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:01.157291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1139/2291] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:19:01.162196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.175999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9307-1ba2-4ad4-a2f7-d2b1fca0308a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.183980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.184652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.184939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.185214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.185990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:19:01.186293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.187922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.207189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1153/2292] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:19:01.208372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.223174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f9358-4898-4008-8446-a1430240d3b1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.228690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.229371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.229855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.230136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.230821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.232748 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.380517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1140/2293] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:19:01 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:19:01.384134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.394752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719b2fd-e9fb-49fc-afc1-7612c783d66e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.476719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.477440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.477755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.478032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.478781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.480643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.582970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1154/2294] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:19:01 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:01.588252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.605662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc7e4-d1fd-4e67-bef2-01a52bd84cd2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.612910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.613871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.614405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.615009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.615811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.617805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.630479 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1141/2295] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:01.635487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.647165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19799a-d568-4a42-bb2c-1c1f57116d3b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.653478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.654281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.654637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.655239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.656065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.657791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438039-e825-4c2f-87a1-5bd9514564ec admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.671237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1155/2296] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:01.675860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:01.690310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619749-6729-4c65-851c-e078eda2e24d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:01.702147 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:01.704419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.704419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.704419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] PATH_INFO: `/v3/projects/1d6a5bb8985848e4a935d46af1af613d/users/fc733384bea64979ab015db1692e7551/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.742462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6a5bb8985848e4a935d46af1af613d, user_id=fc733384bea64979ab015db1692e7551, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:01.743246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:01.867714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:01.867999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:01.868319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:01.870130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1142/2297] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:01 2022] PUT /identity/v3/projects/1d6a5bb8985848e4a935d46af1af613d/users/fc733384bea64979ab015db1692e7551/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:19:01.910247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] MFA Rules not processed for user `fc733384bea64979ab015db1692e7551`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:01.910883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:01.916567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:02.038306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1156/2298] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:02.046849 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:02.124546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523073-9b73-455f-bb49-9641cd546d73 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:02.132177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:02.132177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:02.132177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:02.132177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:02.132638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:02.135335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:02.255535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1143/2299] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:19:02 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:02.260450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:02.272242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b105d-1c2b-44a8-b9d2-4fbb663bfe36 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:02.425908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:02.425908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:02.425908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:02.425908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:02.427669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:02.427669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:03.288813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1157/2300] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:19:02 2022] POST /identity/v3/users => generated 289 bytes in 1025 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:19:03.292425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:03.306250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685a2c-7d3e-426d-b33f-3afedafb786a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:03.311167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:03.311846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:03.312203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:03.312675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:03.313451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:03.315582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:03.330975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1144/2301] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:03.331698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:03.344044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e5ca-f881-47ed-a482-5afcd58dfc6c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:03.348688 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:03.351669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:03.351669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:03.351669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:03.351669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:03.353148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5de986-64eb-4247-8c40-b343e286c6cb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:03.365032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1158/2302] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:19:03.370033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:03.386110 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4026fe-5e0e-4fd4-b67e-373573966422 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:03.390471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:03.391463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:03.391812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:03.392161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] PATH_INFO: `/v3/projects/5c4f5e08c5f8479f81a46c2c985bd82b/users/8a5df86fc4a1461b8f243627ab292c66/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:03.394764 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:03.411343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4f5e08c5f8479f81a46c2c985bd82b, user_id=8a5df86fc4a1461b8f243627ab292c66, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:03.415572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:03.565827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1145/2303] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:03 2022] PUT /identity/v3/projects/5c4f5e08c5f8479f81a46c2c985bd82b/users/8a5df86fc4a1461b8f243627ab292c66/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:03.639889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:03.640228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:03.640228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:03.671343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] MFA Rules not processed for user `8a5df86fc4a1461b8f243627ab292c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:03.672576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:03.753817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1159/2304] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:03.759092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:03.833181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ada8-f473-4745-a2c6-2e067f133188 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:03.839209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:03.839908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:03.840191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:03.840474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:03.841178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:03.843211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:03.962213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1146/2305] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:19:03 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:03.966512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:03.978190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096de7c-4c01-48dc-b3a4-cb7034090366 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:03.988261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:04.043833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.044518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.044824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.045102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.045859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.047820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.192265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1160/2306] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:19:03 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:19:04.193923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:04.207477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89915f-a46c-4267-8470-8cb2d3c996da admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:04.213307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.214207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.214589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.214952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.215755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.217497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.229410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1147/2307] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:19:04.233759 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:04.249266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9291-45b9-4014-af1b-0b12b657f62c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:04.254819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.255757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.256047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.256324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] PATH_INFO: `/v3/projects/6c328dfe4f024a759adee8974b13b67c/users/49f64a7eb7c24e95ae934a2019934c13/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.314830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c328dfe4f024a759adee8974b13b67c, user_id=49f64a7eb7c24e95ae934a2019934c13, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.319089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.406634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1161/2308] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:04 2022] PUT /identity/v3/projects/6c328dfe4f024a759adee8974b13b67c/users/49f64a7eb7c24e95ae934a2019934c13/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:04.410839 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:04.424023 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760dcf3-91b1-4fe0-a77b-25ba61883df9 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:04.545269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.546251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.546752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.547187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.548006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.549636 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19188f-b67a-4ac1-a7f5-152025a1edde admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.581508 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1148/2309] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:04.586189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:04.600567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c94b-1470-474a-aa1f-d0c323f8b668 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:04.612741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.612741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.612741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.612741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] PATH_INFO: `/v3/projects/6c328dfe4f024a759adee8974b13b67c/users/49f64a7eb7c24e95ae934a2019934c13/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.613445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c328dfe4f024a759adee8974b13b67c, user_id=49f64a7eb7c24e95ae934a2019934c13, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.613956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.629659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1162/2310] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:04 2022] PUT /identity/v3/projects/6c328dfe4f024a759adee8974b13b67c/users/49f64a7eb7c24e95ae934a2019934c13/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:04.640341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.640628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.640912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.675030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] MFA Rules not processed for user `49f64a7eb7c24e95ae934a2019934c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:04.676270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:04.734496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:04.774202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1149/2311] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:04.785787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:04.788340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:04.859292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f98d-5d20-4fef-b52a-131721e95805 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:04.863118 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:04.863818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:04.864066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:04.864340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:04.874962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:04.876558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:04.890781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1163/2312] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:05.043050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:05.044457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:05.057065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25988ba-a0c3-454d-88de-40a7a2579f5e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:05.061199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:05.062001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:05.062288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:05.062568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:05.123704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:05.125149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b4d19-faa7-4574-9c1b-c87938cf8eaf service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:05.135038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1150/2313] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:09.857375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:09.950747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37603-5e5d-4835-9f05-ff1e1fca7e84 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:09.956014 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:09.956901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:09.957186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:09.957469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] PATH_INFO: `/v3/users/fc733384bea64979ab015db1692e7551` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:09.958979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc733384bea64979ab015db1692e7551)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:09.961284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:09.975283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:10.249448 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc733384bea64979ab015db1692e7551'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:10.250072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc733384bea64979ab015db1692e7551'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:10.257846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc733384bea64979ab015db1692e7551'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:10.270507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc733384bea64979ab015db1692e7551'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:10.376296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc733384bea64979ab015db1692e7551'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:10.386875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1164/2314] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:09 2022] DELETE /identity/v3/users/fc733384bea64979ab015db1692e7551 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:10.391984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:10.392545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:10.392545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:10.421378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:10.422896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:10.496013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1151/2315] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:10.505945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:10.507502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:10.572533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38ea6-20be-4aeb-85ec-1d27ae5c7d07 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:10.587204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:10.587204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:10.587204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:10.587204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:10.595446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:10.597062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:10.608237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1165/2316] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:11.338880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:11.347821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:11.361547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ef5f-e32f-4b45-8d02-d7c3a39d9795 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:11.370544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:11.371469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:11.371760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:11.372038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] PATH_INFO: `/v3/projects/1d6a5bb8985848e4a935d46af1af613d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:11.375905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6a5bb8985848e4a935d46af1af613d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:11.378124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:11.536563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6a5bb8985848e4a935d46af1af613d', 'request_id': 'req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:11.547831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6a5bb8985848e4a935d46af1af613d', 'request_id': 'req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:11.633324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6a5bb8985848e4a935d46af1af613d', 'request_id': 'req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:11.645545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:11.651578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] The token cache is being invalidate because project 1d6a5bb8985848e4a935d46af1af613d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:11.652012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:11.653412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:11.662070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1152/2317] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:11 2022] DELETE /identity/v3/projects/1d6a5bb8985848e4a935d46af1af613d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:11.667766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:11.682240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb91e-89f6-4055-9560-a157cdb87f2e service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:11.781312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:11.782238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:11.782517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:11.782785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] PATH_INFO: `/v3/users/8a5df86fc4a1461b8f243627ab292c66` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:11.784029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5df86fc4a1461b8f243627ab292c66)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:11.785996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:12.064303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:12.083502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5df86fc4a1461b8f243627ab292c66'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:12.084257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5df86fc4a1461b8f243627ab292c66'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:12.096097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5df86fc4a1461b8f243627ab292c66'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:12.116067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5df86fc4a1461b8f243627ab292c66'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:12.250638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5df86fc4a1461b8f243627ab292c66'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:12.250638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1166/2318] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:11 2022] DELETE /identity/v3/users/8a5df86fc4a1461b8f243627ab292c66 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:13.208982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:13.212538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:13.245221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa988-1805-4b2f-a3b4-6aaf12c7c4ee admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:13.345241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:13.346192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:13.347358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:13.347630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] PATH_INFO: `/v3/projects/5c4f5e08c5f8479f81a46c2c985bd82b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:13.349546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4f5e08c5f8479f81a46c2c985bd82b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:13.352008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:13.483186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4f5e08c5f8479f81a46c2c985bd82b', 'request_id': 'req-39a3950c-d4a0-4024-9620-7b06b1f7f25a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.495050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4f5e08c5f8479f81a46c2c985bd82b', 'request_id': 'req-39a3950c-d4a0-4024-9620-7b06b1f7f25a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.605546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4f5e08c5f8479f81a46c2c985bd82b', 'request_id': 'req-39a3950c-d4a0-4024-9620-7b06b1f7f25a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.618701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] The token cache is being invalidate because project 5c4f5e08c5f8479f81a46c2c985bd82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:13.620060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.620060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.621371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1153/2319] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:13 2022] DELETE /identity/v3/projects/5c4f5e08c5f8479f81a46c2c985bd82b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:13.625929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:13.627701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:13.641765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff648b-1d8e-477f-876c-64bc373c7b2d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:13.704996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:13.705935 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:13.706217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:13.706490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] PATH_INFO: `/v3/users/49f64a7eb7c24e95ae934a2019934c13` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:13.707815 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f64a7eb7c24e95ae934a2019934c13)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:13.710190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:13.987569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f64a7eb7c24e95ae934a2019934c13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.988394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f64a7eb7c24e95ae934a2019934c13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:13.997150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f64a7eb7c24e95ae934a2019934c13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:14.015887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f64a7eb7c24e95ae934a2019934c13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:14.159542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bebef0a3-177e-413d-a320-313a48b1f79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f64a7eb7c24e95ae934a2019934c13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:14.171274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1167/2320] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:13 2022] DELETE /identity/v3/users/49f64a7eb7c24e95ae934a2019934c13 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:14.796679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:14.811740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:14.869363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3950c-d4a0-4024-9620-7b06b1f7f25a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:14.952438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:14.953376 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:14.953686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:14.953972 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] PATH_INFO: `/v3/projects/6c328dfe4f024a759adee8974b13b67c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:14.955304 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c328dfe4f024a759adee8974b13b67c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:14.958012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.087695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:15.100866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c328dfe4f024a759adee8974b13b67c', 'request_id': 'req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:15.108088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c328dfe4f024a759adee8974b13b67c', 'request_id': 'req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:15.216369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c328dfe4f024a759adee8974b13b67c', 'request_id': 'req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:15.228420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] The token cache is being invalidate because project 6c328dfe4f024a759adee8974b13b67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:15.228714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:15.229368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-950d5e1f-bc4a-493f-b4df-5d4c0dcc502f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:15.231202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1154/2321] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:14 2022] DELETE /identity/v3/projects/6c328dfe4f024a759adee8974b13b67c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:15.237051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.237564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.237819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.256521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:15.257867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:15.287785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:15.342408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1168/2322] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:15.351253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.351548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.352648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.380280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:15.381648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:15.391268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1155/2323] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:19:15.395918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.410050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642e7b-45cd-4533-8584-9f95fef26451 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.417884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.420250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.420250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.420250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.420250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:19:15.420250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.421743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.434463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1169/2324] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:19:15.439426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.449518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cc706-a8d1-4f65-8aa4-c2c5d9f73a87 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.454470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.455134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.455417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.456430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.456430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.458357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.583837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1156/2325] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:19:15 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:15.588427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.598825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00451-3d9b-428f-a2fa-447dfa1823f8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.659473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.660152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.660608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.661251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.662004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.663918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.683827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.686047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:15.764369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40d407-b418-4976-91f5-002f77140729 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.768317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.768988 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.769279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.769552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.771438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:15.782910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1170/2326] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:19:15 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:19:15.787440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.798713 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef6b7d-0540-4384-ae23-4b9fe241c0c1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.810476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.811320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.817434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.817434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.817434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.817434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.830680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1171/2327] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:15.831709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.846503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598a119-a3f8-431d-9975-0814fa3d16ab admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.852455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.853032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.853321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.853691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.854551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.856020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.867856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1172/2328] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:15.871720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:15.880442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.881942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93913dd-29ad-4d10-9881-4eec9d9ba399 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:15.882115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423c23-4a90-4d9f-bb4a-84f4e26c8507 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:15.887496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:15.888397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:15.888661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:15.888932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] PATH_INFO: `/v3/projects/13ccfc9838114f839c2f48a2d14533af/users/5a79d784e2fd4be585505d5f51f28bf4/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:15.893820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1157/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:19:15.911829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ccfc9838114f839c2f48a2d14533af, user_id=5a79d784e2fd4be585505d5f51f28bf4, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:15.915183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:16.029339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1173/2330] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:15 2022] PUT /identity/v3/projects/13ccfc9838114f839c2f48a2d14533af/users/5a79d784e2fd4be585505d5f51f28bf4/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:19:16.048042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e590d-66b4-474c-8f7b-cfd325c5f9ea None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:16.048331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e590d-66b4-474c-8f7b-cfd325c5f9ea None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:16.048613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e590d-66b4-474c-8f7b-cfd325c5f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:16.080555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-fc8e590d-66b4-474c-8f7b-cfd325c5f9ea None None] MFA Rules not processed for user `5a79d784e2fd4be585505d5f51f28bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:16.081830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-fc8e590d-66b4-474c-8f7b-cfd325c5f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:16.115384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:16.156785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1158/2331] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:19:16.168967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:16.170829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:16.234862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305acf08-8cbc-4ada-9143-de2c6799cdf5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:16.238873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:16.239529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:16.239805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:16.240085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:16.253387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:16.254930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:16.265910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1174/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:16.474642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:16.474642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:16.474940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:16.495667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:16.496989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:16.568535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1159/2333] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:16.585839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:16.588215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:16.593927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:16.667663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090f43-5aff-4445-86e3-788944922d24 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:16.672864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:16.673540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:16.673907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:16.674174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:16.683932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:16.685539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1212a3-2361-42f4-8a17-e869e6e7f0a1 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:16.694449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1175/2334] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:19:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:19:20.738237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:20.813660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d1dd-3542-41e3-b39a-5dcb244fe630 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:20.818329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:20.819275 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:20.819562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:20.819837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] PATH_INFO: `/v3/users/5a79d784e2fd4be585505d5f51f28bf4` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:20.821679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a79d784e2fd4be585505d5f51f28bf4)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:20.823772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:21.022753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a79d784e2fd4be585505d5f51f28bf4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:21.030953 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a79d784e2fd4be585505d5f51f28bf4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:21.031712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a79d784e2fd4be585505d5f51f28bf4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:21.050424 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a79d784e2fd4be585505d5f51f28bf4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:21.054665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:21.113459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a79d784e2fd4be585505d5f51f28bf4'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:21.123654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1160/2335] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:20 2022] DELETE /identity/v3/users/5a79d784e2fd4be585505d5f51f28bf4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:21.130924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405528-2e57-42a9-9936-286964586494 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:21.131340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405528-2e57-42a9-9936-286964586494 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:21.131480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9405528-2e57-42a9-9936-286964586494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:21.151103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d9405528-2e57-42a9-9936-286964586494 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:21.152470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d9405528-2e57-42a9-9936-286964586494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:21.220253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1176/2336] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:21.230100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:21.232117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:21.316852 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2bad-26e7-4921-8a3b-009e24f88b4f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:21.320605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:21.321389 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:21.321708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:21.321987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:21.333183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:21.333736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d0499-003a-44f4-994d-38415cde3786 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:21.345092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1161/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:21.863693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9405528-2e57-42a9-9936-286964586494 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:21.865184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d9405528-2e57-42a9-9936-286964586494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:21.878601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9405528-2e57-42a9-9936-286964586494 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:21.889162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:21.890121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:21.890403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:21.890680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] PATH_INFO: `/v3/projects/13ccfc9838114f839c2f48a2d14533af` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:21.891914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ccfc9838114f839c2f48a2d14533af)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:21.893870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:22.032698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ccfc9838114f839c2f48a2d14533af', 'request_id': 'req-f60c1637-6458-4890-8ea3-ca31bf2d80b2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:22.038953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ccfc9838114f839c2f48a2d14533af', 'request_id': 'req-f60c1637-6458-4890-8ea3-ca31bf2d80b2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:22.141903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ccfc9838114f839c2f48a2d14533af', 'request_id': 'req-f60c1637-6458-4890-8ea3-ca31bf2d80b2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:22.155780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] The token cache is being invalidate because project 13ccfc9838114f839c2f48a2d14533af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:22.156082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:22.156768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f60c1637-6458-4890-8ea3-ca31bf2d80b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:22.158464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1177/2338] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:21 2022] DELETE /identity/v3/projects/13ccfc9838114f839c2f48a2d14533af => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:29.366422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76fe3-802f-4f7d-8fe6-aa2e64798d3e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:29.366935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76fe3-802f-4f7d-8fe6-aa2e64798d3e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:29.367053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76fe3-802f-4f7d-8fe6-aa2e64798d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:29.385142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-57a76fe3-802f-4f7d-8fe6-aa2e64798d3e None None] MFA Rules not processed for user `8b273bb179aa4dc987fd7f67c7131724`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:29.386398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-57a76fe3-802f-4f7d-8fe6-aa2e64798d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:29.443591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1162/2339] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:19:32.152557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:38.649880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b66ef-1e14-497c-b2e8-a44248d5d87b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:38.650525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b66ef-1e14-497c-b2e8-a44248d5d87b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:38.650525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b66ef-1e14-497c-b2e8-a44248d5d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:38.669005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0d8b66ef-1e14-497c-b2e8-a44248d5d87b None None] MFA Rules not processed for user `658611df52f34f87a074a3467a42d4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:38.670183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d8b66ef-1e14-497c-b2e8-a44248d5d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:38.727465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1178/2340] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:39.435966 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=53 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:48.719974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=25 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:11.275597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:11.276127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:11.276238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:11.294971 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] MFA Rules not processed for user `cb30fcf6e0494463a3172bb37e38ab85`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:11.296165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:11.353697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1163/2341] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:21.346354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=25 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:24.139979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:24.140841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:24.140841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:24.160228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] MFA Rules not processed for user `95a0d5d3971a41c1ab6f65b953661393`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:24.161531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:24.219474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1179/2342] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:32.978983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:32.980566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:33.041705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c19bc4-a1fb-4af0-81bb-0a4b55fae549 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:33.045844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:33.046678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:33.047098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:33.047307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:33.049305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:33.136503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:33.138590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:33.155116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1164/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:34.212732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=25 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:34.463186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:34.464740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:34.533215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971de55-f603-4e40-b75f-1cbf7b23a851 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:34.537381 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:34.538137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:34.538421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:34.538695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:34.541131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:34.556966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:34.558494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:34.572201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1180/2344] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:43.146847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=54 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:44.565840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=26 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:46.133350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:46.135065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:46.150216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64316a-d623-414b-bb77-b391029fc5e4 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:46.155966 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:46.156560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:46.156848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:46.157132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:46.159117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:46.170848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:46.172600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:46.182586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1165/2345] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:51.343747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:51.354241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa071ddc-ae12-496a-ad28-40f10832295f service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:51.357921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:51.358571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:51.359055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:51.359343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:51.361233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:51.426754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:51.428294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:51.438613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1181/2346] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:55.366812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:55.368423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:55.388442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65528865-5894-4116-be22-b3141bf15af6 service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:55.393132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:55.394055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:55.394385 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:55.394671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] PATH_INFO: `/v3/users/658611df52f34f87a074a3467a42d4f5` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:55.395869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] RBAC: Authorizing `identity:delete_user(user_id=658611df52f34f87a074a3467a42d4f5)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:55.397871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:55.581910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658611df52f34f87a074a3467a42d4f5'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:55.589732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658611df52f34f87a074a3467a42d4f5'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:55.590453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658611df52f34f87a074a3467a42d4f5'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:55.604593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658611df52f34f87a074a3467a42d4f5'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:55.703437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-33951821-2e4a-4170-a786-69fd3022facb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658611df52f34f87a074a3467a42d4f5'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:55.710174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1166/2347] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:20:55 2022] DELETE /identity/v3/users/658611df52f34f87a074a3467a42d4f5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:56.001270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.021440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456973c-dd56-42a0-b788-93fc69e5f687 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.102619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.103499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.103768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.104046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] PATH_INFO: `/v3/projects/d2129c74d9eb4704ae84a53173ea4443` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.105249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2129c74d9eb4704ae84a53173ea4443)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.107207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.159719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389004d5-7159-4d9c-bcfa-fc2bb011cb47 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.160014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389004d5-7159-4d9c-bcfa-fc2bb011cb47 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.160298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389004d5-7159-4d9c-bcfa-fc2bb011cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.177480 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-389004d5-7159-4d9c-bcfa-fc2bb011cb47 None None] MFA Rules not processed for user `8b273bb179aa4dc987fd7f67c7131724`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:56.178730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-389004d5-7159-4d9c-bcfa-fc2bb011cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.224853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2129c74d9eb4704ae84a53173ea4443', 'request_id': 'req-6e495296-a670-4749-8442-0393b438e080'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:56.231046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2129c74d9eb4704ae84a53173ea4443', 'request_id': 'req-6e495296-a670-4749-8442-0393b438e080'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:56.238076 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1167/2348] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:20:56.297462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2129c74d9eb4704ae84a53173ea4443', 'request_id': 'req-6e495296-a670-4749-8442-0393b438e080'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:56.310249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] The token cache is being invalidate because project d2129c74d9eb4704ae84a53173ea4443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:20:56.310519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:56.311273 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6e495296-a670-4749-8442-0393b438e080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:56.312919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1182/2349] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:20:55 2022] DELETE /identity/v3/projects/d2129c74d9eb4704ae84a53173ea4443 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:56.317956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.318249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.318533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.338727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:56.340130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.402276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1168/2350] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:56.409951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.410245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.410530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.429427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:56.431860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.443511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1183/2351] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:56.448332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.456654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:56.459760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937a7c7-5e82-4b79-bb52-1ef84724eb98 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.465343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.466116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.466392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.466666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.467395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:20:56.467702 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.469326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.482534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1169/2352] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:20:56.488005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.501973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d60b4-3959-44e2-9eae-97fcc799178d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.506952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.510175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.510175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.510175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.510175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.510860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.526293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:56.561187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.563041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.615402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1184/2353] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:20:56.616655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.624121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d10a1a-7e0c-4ef7-baa7-4e2a41cf1a9c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.676345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.677264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.677556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.677866 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.679807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.680928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358356eb-0408-44d5-a8fc-395ec15bf728 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.685901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.686522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.686805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.687145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.687771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.689757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.690810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.692295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.701365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1170/2354] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:20:56.754603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1185/2355] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:20:56.765166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.778300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142ec2-810c-47c7-8962-17b975026245 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.783294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d974330-f737-485d-9454-96189329c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.783976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d974330-f737-485d-9454-96189329c6db admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.784261 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d974330-f737-485d-9454-96189329c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.784540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d974330-f737-485d-9454-96189329c6db admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.785272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d974330-f737-485d-9454-96189329c6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.786928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d974330-f737-485d-9454-96189329c6db admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.799552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1171/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:56.803856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.814595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cccb-252d-4245-84d9-d719c3c8cd9a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.820233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.820956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.821237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.821517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.822342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.823960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c2d12-6e6b-47c3-8f7e-ab2de1dbba59 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.838767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1186/2357] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:56.843712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d974330-f737-485d-9454-96189329c6db admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.855201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d974330-f737-485d-9454-96189329c6db admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.862109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.864802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.864802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.864802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] PATH_INFO: `/v3/projects/afe989f5619447368e8ea042e101879f/users/4434468096604f15a54eadee8610f2b0/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.882146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe989f5619447368e8ea042e101879f, user_id=4434468096604f15a54eadee8610f2b0, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.886309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.987753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1172/2358] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:20:56 2022] PUT /identity/v3/projects/afe989f5619447368e8ea042e101879f/users/4434468096604f15a54eadee8610f2b0/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:56.999472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.999766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.000051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.028890 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] MFA Rules not processed for user `4434468096604f15a54eadee8610f2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:57.030154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:57.107299 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1187/2359] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:57.111701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.114298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.115710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:57.192451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74503e-1a9e-41f7-88dd-5af3ba8992d2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.196642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf608240-b985-4f12-b2f6-e24726f8960a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.197789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.198462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.198749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.199030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.199730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.201705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.201934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.202676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.203020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.203296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.205178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:57.214538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:57.218961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.220548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.230632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1188/2360] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:20:57.281923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:57.288310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1173/2361] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:20:57 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:20:57.293130 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.306728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5adcf9-337e-4edc-a21b-cc4d13ece2b9 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.366661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.367965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.368249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.368524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.369257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.371257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.475340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1189/2362] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:20:57 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:20:57.479578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.490170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1e307-19a7-4201-b4c8-8077ddb7471b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.495445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.496113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.499410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.499410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.499410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.499410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.510756 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1174/2363] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:57.515019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.525294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc92356-00c2-43b4-9a3c-7ba3cb53b808 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.529997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.530879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.531157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.531431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] PATH_INFO: `/v3/projects/eb81c301c31f4505ad375df8838ee8dc/users/e2e324c525714713a4d1c7a4089db41f/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.546740 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb81c301c31f4505ad375df8838ee8dc, user_id=e2e324c525714713a4d1c7a4089db41f, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.549647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.653060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1190/2364] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:20:57 2022] PUT /identity/v3/projects/eb81c301c31f4505ad375df8838ee8dc/users/e2e324c525714713a4d1c7a4089db41f/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:57.657294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.668441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d16f-97ad-4017-9a5a-f84e0450c2a7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.728921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.729507 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.729818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.730097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.730827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.732856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c50fd-69a9-4e06-bf42-be4d25630828 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.744007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1175/2365] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:57.748320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.758954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7c611-cd46-4acb-95bd-720959b138e3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.763719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.764624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.764907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.765182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] PATH_INFO: `/v3/projects/eb81c301c31f4505ad375df8838ee8dc/users/e2e324c525714713a4d1c7a4089db41f/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.767230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb81c301c31f4505ad375df8838ee8dc, user_id=e2e324c525714713a4d1c7a4089db41f, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.769958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.782076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1191/2366] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:20:57 2022] PUT /identity/v3/projects/eb81c301c31f4505ad375df8838ee8dc/users/e2e324c525714713a4d1c7a4089db41f/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:57.793204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.793597 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.793961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.824001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] MFA Rules not processed for user `e2e324c525714713a4d1c7a4089db41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:57.825219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:57.894533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1176/2367] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:20:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:57.906778 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:57.908580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:57.967594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93734-3a88-4557-b38a-4e2f7384a291 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:57.971388 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:57.972032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:57.972316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:57.972591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:57.983259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:57.984968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:57.996511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1192/2368] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:20:58.270404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:58.281060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dd5c9-d4b4-4d27-aefa-6f5bbcf993ec None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:58.284889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:58.285749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:58.286027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:58.286305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:58.344926 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:58.346462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56e5e4-e8d6-4898-bba2-6ce2b89859a9 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:58.356774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1177/2369] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:21:07.256942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:07.310820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:07.326577 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818a69f-9cd1-4de7-915d-2adbd238f407 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:07.334018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:07.334972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:07.335500 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:07.335860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] PATH_INFO: `/v3/users/4434468096604f15a54eadee8610f2b0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:07.337903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4434468096604f15a54eadee8610f2b0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:07.341174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:07.570040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4434468096604f15a54eadee8610f2b0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:07.570677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4434468096604f15a54eadee8610f2b0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:07.577647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4434468096604f15a54eadee8610f2b0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:07.591075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4434468096604f15a54eadee8610f2b0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:07.709058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4434468096604f15a54eadee8610f2b0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:07.717147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1193/2370] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:07 2022] DELETE /identity/v3/users/4434468096604f15a54eadee8610f2b0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:07.721694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:07.722212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:07.722355 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:07.741014 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:07.742318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:07.746608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:07.806143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1178/2371] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:07.816109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:07.817538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:07.876533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a5d5-0363-481e-a8ca-5c094ac45998 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:07.880017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:07.880659 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:07.880943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:07.881220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:07.890543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:07.891973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:07.902331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1194/2372] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:08.362222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:08.363720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:08.378012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd61d-11f2-4365-b7af-75355e71e7d1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:08.383858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:08.385204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:08.385778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:08.386106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] PATH_INFO: `/v3/projects/afe989f5619447368e8ea042e101879f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:08.388107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe989f5619447368e8ea042e101879f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:08.390097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:08.531909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe989f5619447368e8ea042e101879f', 'request_id': 'req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.539943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe989f5619447368e8ea042e101879f', 'request_id': 'req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.611722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe989f5619447368e8ea042e101879f', 'request_id': 'req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.624287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] The token cache is being invalidate because project afe989f5619447368e8ea042e101879f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:08.624845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.625526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.627265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1179/2373] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:08 2022] DELETE /identity/v3/projects/afe989f5619447368e8ea042e101879f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:08.631436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:08.641791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98c50-6b29-4261-815c-dfe69c0330d5 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:08.706660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:08.707530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:08.707837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:08.708111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] PATH_INFO: `/v3/users/e2e324c525714713a4d1c7a4089db41f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:08.709366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e324c525714713a4d1c7a4089db41f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:08.711678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:08.726473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:08.898824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e324c525714713a4d1c7a4089db41f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.899897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e324c525714713a4d1c7a4089db41f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.913084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e324c525714713a4d1c7a4089db41f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:08.929031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e324c525714713a4d1c7a4089db41f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.011999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d30ead2f-9800-4634-b93b-9388547d3b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e324c525714713a4d1c7a4089db41f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.018771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1195/2374] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:08 2022] DELETE /identity/v3/users/e2e324c525714713a4d1c7a4089db41f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:09.436426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:09.438192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:09.451233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2d823-7f8b-4807-b0ef-e38cb3a4063e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:09.511142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:09.512041 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:09.512329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:09.512610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] PATH_INFO: `/v3/projects/eb81c301c31f4505ad375df8838ee8dc` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:09.513826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb81c301c31f4505ad375df8838ee8dc)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:09.515746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:09.614606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:09.624097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb81c301c31f4505ad375df8838ee8dc', 'request_id': 'req-892b947f-b427-4774-aac9-046556c8a3b7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.630281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb81c301c31f4505ad375df8838ee8dc', 'request_id': 'req-892b947f-b427-4774-aac9-046556c8a3b7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.703211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb81c301c31f4505ad375df8838ee8dc', 'request_id': 'req-892b947f-b427-4774-aac9-046556c8a3b7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.715767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] The token cache is being invalidate because project eb81c301c31f4505ad375df8838ee8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:09.716114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.716763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-892b947f-b427-4774-aac9-046556c8a3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:09.718797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1180/2375] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:09 2022] DELETE /identity/v3/projects/eb81c301c31f4505ad375df8838ee8dc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:09.724676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:09.725170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:09.725270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:09.745864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:09.747074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:09.810758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1196/2376] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:09.819435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:09.819809 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:09.820154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:09.842553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:09.843779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:09.852763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1181/2377] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:09.857435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:09.867417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc163c-bb40-4138-b467-dc58cda10ce7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:09.872201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:09.872862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:09.873142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:09.873417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:09.874232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:21:09.874534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:09.876144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:09.888883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1197/2378] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:21:09.894791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:09.905429 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe587-6b18-4b91-93ff-52c33b92cb43 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:09.910874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:09.911551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:09.911830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:09.912104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:09.912800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:09.914766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.011919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1182/2379] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:21:09 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:10.016825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.027612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebffc-a9df-4d98-8419-bf997c8bab44 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.101327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.102044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.102332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.102612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.103345 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.105373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.180278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1198/2380] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:21:10 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:10.185902 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.196619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a466a-4983-43c7-8bb2-3787b8638e23 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.202112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.202792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.203078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.203358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.204117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.205850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.225051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1183/2381] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:10.226503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.254245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426b52d-0a31-4ff5-b8f4-076325b0762b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.254245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.254245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.254245 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.254569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.254569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.254569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9c06-8952-4982-9792-7ef048d18b79 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.254569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:10.263361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1199/2382] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:10.264452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.276723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b6e51-2f39-4938-a1c0-bc3310223f0c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.282668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.283635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.283911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.284671 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] PATH_INFO: `/v3/projects/b2db38e986524611940fc2504c7a7b2c/users/f963eb3cdc8a4d61882368a2c826c4f0/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.303473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2db38e986524611940fc2504c7a7b2c, user_id=f963eb3cdc8a4d61882368a2c826c4f0, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.306447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.408856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1184/2383] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:21:10 2022] PUT /identity/v3/projects/b2db38e986524611940fc2504c7a7b2c/users/f963eb3cdc8a4d61882368a2c826c4f0/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:10.420863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.421243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.421553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.453734 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] MFA Rules not processed for user `f963eb3cdc8a4d61882368a2c826c4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:10.455305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:10.529298 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1200/2384] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:10.530551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.621226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb264-48b9-4d24-a0e3-7f93c1b66ce0 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.627269 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.628289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.628594 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.628881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.629639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.632263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.763262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1185/2385] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:21:10 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:10.767990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.781851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4c9f-0e0f-4d00-88a6-1f7a5dfaa6a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.842628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.843362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.843651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.843930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.844702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.846658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.951914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1201/2386] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:21:10 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:21:10.955587 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:10.970308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdccefb-b773-430d-9097-1349b374896a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:10.975181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:10.975855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:10.976139 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:10.976420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:10.977168 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:10.978936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:10.997637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1186/2387] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:11.003824 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.013790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa77b1-2335-447a-a642-d11eaa1fed39 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:11.020395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:11.021798 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.022161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.022459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] PATH_INFO: `/v3/projects/f7900a4d51d14048ac8984be4a16da48/users/d1813ca3b15f49a4aed5c643fa79d18b/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.043642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7900a4d51d14048ac8984be4a16da48, user_id=d1813ca3b15f49a4aed5c643fa79d18b, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:11.046845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:11.138922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1202/2388] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:21:11 2022] PUT /identity/v3/projects/f7900a4d51d14048ac8984be4a16da48/users/d1813ca3b15f49a4aed5c643fa79d18b/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:11.143348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.162296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14821561-d4f0-468c-ba20-1ac513c7dc52 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:11.197509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:11.226086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:11.226773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.227063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.227341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.228733 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:11.230775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948424-109c-4af2-b06a-42a1ded44f4f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:11.245173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1187/2389] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:11.246475 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.258785 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f914d9-66b1-481e-a918-0e8b38ac6889 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:11.263648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:11.264542 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.264837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.265138 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] PATH_INFO: `/v3/projects/f7900a4d51d14048ac8984be4a16da48/users/d1813ca3b15f49a4aed5c643fa79d18b/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.268179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7900a4d51d14048ac8984be4a16da48, user_id=d1813ca3b15f49a4aed5c643fa79d18b, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:11.270143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:11.281479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1203/2390] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:21:11 2022] PUT /identity/v3/projects/f7900a4d51d14048ac8984be4a16da48/users/d1813ca3b15f49a4aed5c643fa79d18b/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:11.292834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.293766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.294331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.324783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] MFA Rules not processed for user `d1813ca3b15f49a4aed5c643fa79d18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:11.325018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:11.410266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1188/2391] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:11.422607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.424444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:11.474677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:11.491919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03da33-f7fe-4538-b486-de8ba67b53a7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:11.498292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:11.498862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.499148 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.499429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.534360 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.536543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:11.565941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:11.567314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:11.578326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1204/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:11.613981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874e6ba-83dd-418e-8f71-300a8a003759 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:11.618560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:11.619462 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:11.619887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:11.620180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:11.622266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:11.634295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:11.637272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848139ee-55ee-4f97-b6ed-073c5f4eab76 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:11.647456 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1189/2393] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:21:11.905387 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:11.907086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:12.021532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407714e-9fc5-46e9-bfce-1d0449425f5d service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:12.031588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:12.032304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:12.032593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:12.032871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:12.036324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:12.114603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:12.116442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:12.141819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1205/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:12.297320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:12.298017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:12.298017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:12.322452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:12.323713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:12.413732 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1190/2395] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:12.616144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:12.617630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:12.652924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:12.693393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42f597-360e-40a4-9178-f4a2aed7278a service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:12.699726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:12.700428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:12.700704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:12.700982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:12.709394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:12.711300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:12.721926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1206/2396] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:21:15.092127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:15.093704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:15.100740 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:15.107191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ffd39-6236-4c7b-b632-1fe8e6324572 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:15.111067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:15.111799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:15.112170 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:15.112516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:15.123951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:15.125805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:15.136562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1191/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:21.961476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:21.963610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:22.031280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6d35-aaad-4523-908b-30123648dfab service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:22.036880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:22.037950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:22.038243 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:22.038526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] PATH_INFO: `/v3/users/381ef8fa6a804a08a85ed19503c12daf` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:22.039861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381ef8fa6a804a08a85ed19503c12daf)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:22.042725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:22.224940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381ef8fa6a804a08a85ed19503c12daf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.225559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381ef8fa6a804a08a85ed19503c12daf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.233258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381ef8fa6a804a08a85ed19503c12daf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.245625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381ef8fa6a804a08a85ed19503c12daf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.330900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381ef8fa6a804a08a85ed19503c12daf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.337998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1207/2398] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:21 2022] DELETE /identity/v3/users/381ef8fa6a804a08a85ed19503c12daf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:22.573640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:22.584572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673524-18cf-445d-970b-6ee3bde3a525 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:22.646717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:22.647579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:22.647913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:22.648148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] PATH_INFO: `/v3/projects/dc87a999dad84f3b85259084d38cc93c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:22.649361 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc87a999dad84f3b85259084d38cc93c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:22.652395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:22.767247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc87a999dad84f3b85259084d38cc93c', 'request_id': 'req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.774413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc87a999dad84f3b85259084d38cc93c', 'request_id': 'req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.835192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc87a999dad84f3b85259084d38cc93c', 'request_id': 'req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.851874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] The token cache is being invalidate because project dc87a999dad84f3b85259084d38cc93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:22.852114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.852744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:22.855284 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1192/2399] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:22 2022] DELETE /identity/v3/projects/dc87a999dad84f3b85259084d38cc93c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:21:22.861357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:22.862834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:22.876186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fcb14-4f85-4d81-80ad-483e40657b43 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:22.910379 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:22.934291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:22.935167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:22.935452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:22.935731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] PATH_INFO: `/v3/users/5b368d3c2ad5415b9f29e0dce8621830` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:22.936944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b368d3c2ad5415b9f29e0dce8621830)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:22.939266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:23.072694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b368d3c2ad5415b9f29e0dce8621830'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.073377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b368d3c2ad5415b9f29e0dce8621830'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.080413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b368d3c2ad5415b9f29e0dce8621830'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.093127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b368d3c2ad5415b9f29e0dce8621830'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.170460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b368d3c2ad5415b9f29e0dce8621830'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.177219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1208/2400] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:22 2022] DELETE /identity/v3/users/5b368d3c2ad5415b9f29e0dce8621830 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:23.453603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:23.455074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:23.468799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f423d-ecfd-45b6-bc4f-afab1fb6df1b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:23.533004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:23.533896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:23.534177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:23.534446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] PATH_INFO: `/v3/projects/51371f53aa594df9a9e73d4d1f37af6c` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:23.535738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51371f53aa594df9a9e73d4d1f37af6c)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:23.537721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:23.562074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:23.670550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51371f53aa594df9a9e73d4d1f37af6c', 'request_id': 'req-abd61843-7193-4455-afcf-cddbc838bab1'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.676837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51371f53aa594df9a9e73d4d1f37af6c', 'request_id': 'req-abd61843-7193-4455-afcf-cddbc838bab1'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.760577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51371f53aa594df9a9e73d4d1f37af6c', 'request_id': 'req-abd61843-7193-4455-afcf-cddbc838bab1'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.771503 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] The token cache is being invalidate because project 51371f53aa594df9a9e73d4d1f37af6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:23.771795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.772475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:23.774114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1193/2401] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:23 2022] DELETE /identity/v3/projects/51371f53aa594df9a9e73d4d1f37af6c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:27.939169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:27.940633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:28.016223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca29c0-d31d-4d57-9310-810219c49c4e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:28.074163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:28.089462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:28.090305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:28.090589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:28.090868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:28.092744 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:28.154328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:28.155928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a2c69-51fa-4551-ad54-75c79dcc3697 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:28.165651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1209/2402] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:30.373056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:30.374843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:30.444439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61843-7193-4455-afcf-cddbc838bab1 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:30.449980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:30.450903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:30.451188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:30.451467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] PATH_INFO: `/v3/users/f963eb3cdc8a4d61882368a2c826c4f0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:30.452693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f963eb3cdc8a4d61882368a2c826c4f0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:30.454726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:30.741964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f963eb3cdc8a4d61882368a2c826c4f0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:30.750365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f963eb3cdc8a4d61882368a2c826c4f0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:30.751085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f963eb3cdc8a4d61882368a2c826c4f0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:30.763540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f963eb3cdc8a4d61882368a2c826c4f0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:30.846516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f963eb3cdc8a4d61882368a2c826c4f0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:30.853689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1194/2403] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:30 2022] DELETE /identity/v3/users/f963eb3cdc8a4d61882368a2c826c4f0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:30.864214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:30.864818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:30.864818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:30.882933 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:30.884158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:30.950153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1210/2404] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:30.957452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:30.959114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:30.997037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:31.023955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4002d4-ac82-4eac-95a7-5c4b59adbd6b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:31.028394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:31.031964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:31.031964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:31.031964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:31.039393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:31.040848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:31.051948 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1195/2405] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:31.580315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:31.581896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:31.595968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a222-3e6a-4087-8019-b00a2f2183f0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:31.600859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:31.601841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:31.602126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:31.603174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] PATH_INFO: `/v3/projects/b2db38e986524611940fc2504c7a7b2c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:31.603695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2db38e986524611940fc2504c7a7b2c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:31.606071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:31.740279 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2db38e986524611940fc2504c7a7b2c', 'request_id': 'req-42e44c17-f90e-4506-9b02-cb98562e6f82'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:31.748044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2db38e986524611940fc2504c7a7b2c', 'request_id': 'req-42e44c17-f90e-4506-9b02-cb98562e6f82'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:31.824902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2db38e986524611940fc2504c7a7b2c', 'request_id': 'req-42e44c17-f90e-4506-9b02-cb98562e6f82'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:31.838600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] The token cache is being invalidate because project b2db38e986524611940fc2504c7a7b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:31.838902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:31.839916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:31.842018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1211/2406] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:31 2022] DELETE /identity/v3/projects/b2db38e986524611940fc2504c7a7b2c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:31.846134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:31.865052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe946a8d-dbcd-4f64-a691-27be80a22635 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:31.944785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:31.945713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:31.946007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:31.946295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] PATH_INFO: `/v3/users/d1813ca3b15f49a4aed5c643fa79d18b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:31.947564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1813ca3b15f49a4aed5c643fa79d18b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:31.950439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:32.164362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1813ca3b15f49a4aed5c643fa79d18b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.172561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1813ca3b15f49a4aed5c643fa79d18b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.173306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1813ca3b15f49a4aed5c643fa79d18b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.193658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1813ca3b15f49a4aed5c643fa79d18b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.266302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e6a7a3fe-940e-4316-8169-6f5c436d684c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1813ca3b15f49a4aed5c643fa79d18b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.270022 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1196/2407] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:31 2022] DELETE /identity/v3/users/d1813ca3b15f49a4aed5c643fa79d18b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:32.723814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:32.725199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:32.741717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44c17-f90e-4506-9b02-cb98562e6f82 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:32.757286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:32.805801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:32.806951 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:32.808131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:32.808429 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] PATH_INFO: `/v3/projects/f7900a4d51d14048ac8984be4a16da48` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:32.809919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7900a4d51d14048ac8984be4a16da48)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:32.811961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:32.954976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7900a4d51d14048ac8984be4a16da48', 'request_id': 'req-26385796-fff4-4a46-9478-a61626993c9b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:32.962061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7900a4d51d14048ac8984be4a16da48', 'request_id': 'req-26385796-fff4-4a46-9478-a61626993c9b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:33.063883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7900a4d51d14048ac8984be4a16da48', 'request_id': 'req-26385796-fff4-4a46-9478-a61626993c9b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:33.076639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] The token cache is being invalidate because project f7900a4d51d14048ac8984be4a16da48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:33.076931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:33.077646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-26385796-fff4-4a46-9478-a61626993c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:33.079234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1212/2408] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:32 2022] DELETE /identity/v3/projects/f7900a4d51d14048ac8984be4a16da48 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:33.085028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.085819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.086234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.105067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:33.106520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:33.154821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:33.170125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1197/2409] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:33.178873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.181224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.181224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.199467 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:33.200808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:33.209863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1213/2410] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:33.214891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.225016 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53582265-ef48-4a42-a6fb-400a428c4b87 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.231001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.231776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.232067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.232352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.233099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:21:33.233420 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.235141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.249294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1198/2411] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:21:33.254427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.266172 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dec0c-e3e3-4ed2-a66a-325740130aba None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.271188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.271882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.272396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.272575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.273260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.275230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.423701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1214/2412] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:21:33 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:33.424848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.436418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544666c-214d-43b7-b499-f98650879188 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.503537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.504214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.504499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.504774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.505463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.507407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.623945 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1199/2413] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:21:33 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:33.627976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.639031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db658c-2f9b-46db-8574-597e29dad62f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.643716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.644370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.644650 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.644966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.645727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.647315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.658844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1215/2414] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:33.663228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.673341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af475-ffd2-4227-9e03-9e789db95897 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.678015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.678672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.678960 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.679238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.679956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.681544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695b4d-9d37-4643-a9ea-e5cfa26e40a4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.691800 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1200/2415] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:33.695942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.706631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc40a5-5d9b-4cf9-9b87-b1878f364cd4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:33.711479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:33.712434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.712718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.712995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] PATH_INFO: `/v3/projects/7d9cfe4621e74b81bc03f72a24243f7e/users/88e8bd0f19254b848511e7fb20ae80c6/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.729497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9cfe4621e74b81bc03f72a24243f7e, user_id=88e8bd0f19254b848511e7fb20ae80c6, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:33.732573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:33.847739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1216/2416] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:21:33 2022] PUT /identity/v3/projects/7d9cfe4621e74b81bc03f72a24243f7e/users/88e8bd0f19254b848511e7fb20ae80c6/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:33.858153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791241d-3452-489c-abfa-d318cee64487 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:33.868363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791241d-3452-489c-abfa-d318cee64487 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:33.868363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791241d-3452-489c-abfa-d318cee64487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:33.887510 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4791241d-3452-489c-abfa-d318cee64487 None None] MFA Rules not processed for user `88e8bd0f19254b848511e7fb20ae80c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:33.888662 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4791241d-3452-489c-abfa-d318cee64487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:33.958820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1201/2417] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:33.970550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.972231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:33.998025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791241d-3452-489c-abfa-d318cee64487 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:34.001211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4791241d-3452-489c-abfa-d318cee64487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.025958 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:34.039480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c62d7-a164-4f23-a140-c59d46bd78a7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:34.044469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:34.045207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.045561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.045945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.055664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:34.057292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:34.061663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:34.067891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1217/2418] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:34.092158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791241d-3452-489c-abfa-d318cee64487 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:34.093162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:34.098380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:34.101102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.101102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.101102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.103001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.121253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:34.123100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d28d-9292-4fa2-95a3-6c14abc03072 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:34.155910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1202/2419] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:34.166389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e113-f276-4e9b-aae5-d722bd7c7aa4 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:34.173351 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:34.174774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.175161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.175610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] PATH_INFO: `/v3/users/88e8bd0f19254b848511e7fb20ae80c6` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.176967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e8bd0f19254b848511e7fb20ae80c6)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:34.185061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:34.368549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e8bd0f19254b848511e7fb20ae80c6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:34.369259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e8bd0f19254b848511e7fb20ae80c6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:34.376649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e8bd0f19254b848511e7fb20ae80c6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:34.388438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e8bd0f19254b848511e7fb20ae80c6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:34.519719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e8bd0f19254b848511e7fb20ae80c6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:34.526086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1218/2420] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:34 2022] DELETE /identity/v3/users/88e8bd0f19254b848511e7fb20ae80c6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:34.534821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c076-f835-4218-9520-e397ac313a57 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.535117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c076-f835-4218-9520-e397ac313a57 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.535432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858c076-f835-4218-9520-e397ac313a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.554279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e858c076-f835-4218-9520-e397ac313a57 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:34.555561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e858c076-f835-4218-9520-e397ac313a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.620919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1203/2421] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:34.630598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:34.632121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.699443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a566-a2de-48fb-b189-523d406f5889 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:34.703112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:34.703817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.704042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.704319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.721741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:34.721741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5453b-311c-42b3-984f-91e05a6da530 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:34.726726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1219/2422] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:35.191353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c076-f835-4218-9520-e397ac313a57 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.192995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e858c076-f835-4218-9520-e397ac313a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:35.205794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858c076-f835-4218-9520-e397ac313a57 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.211354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.212210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.212497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.212829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] PATH_INFO: `/v3/projects/7d9cfe4621e74b81bc03f72a24243f7e` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.214630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9cfe4621e74b81bc03f72a24243f7e)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.216616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.310910 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9cfe4621e74b81bc03f72a24243f7e', 'request_id': 'req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:35.317425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9cfe4621e74b81bc03f72a24243f7e', 'request_id': 'req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:35.377651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9cfe4621e74b81bc03f72a24243f7e', 'request_id': 'req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:35.389566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] The token cache is being invalidate because project 7d9cfe4621e74b81bc03f72a24243f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:35.389887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:35.390525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-5ac1def2-4511-477c-8c13-1f04c2cc2ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:35.392062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1204/2423] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:35 2022] DELETE /identity/v3/projects/7d9cfe4621e74b81bc03f72a24243f7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:35.397745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.398212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.398308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.411185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:35.417362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:35.418708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:35.481622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1220/2424] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:35.489821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.490116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.490403 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.509540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:35.511461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:35.519502 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1205/2425] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:35.523908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.534583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a6063-1ce3-42a4-9a12-5a5e6e611e5c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.539368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.540102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.540439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.542016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.542016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:21:35.542016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.543738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.565083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1221/2426] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:21:35.565243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.572609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccf04f-3eb4-4c11-86af-a65fa3febf8e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.578837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.579509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.579814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.580097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.580821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.582818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1c5dc-7041-4efc-9fe1-c58a80adab01 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.720895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1206/2427] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:21:35 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:21:35.725053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.735841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488254d-62ec-4903-b442-172cb6ace8fe admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.802717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.803037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.803316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.805232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.806041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.806399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.806982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.809169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.811553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.824929 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:35.826208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:35.853068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:35.896856 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1207/2428] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:35.911357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.912801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:35.928818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1222/2429] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:21:35 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:21:35.932088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.942846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d78ef-93c4-4e10-91fd-4717138dc1b9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.948144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.948353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.948663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.948945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.949742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.951329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.964911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1223/2430] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:21:35.969224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:35.982065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13f8f-417d-4e24-b12f-045e4d6abcc7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:35.987044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:35.987710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:35.987992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:35.988268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:35.988981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:35.990614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:35.999600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af087-7099-4318-b0bc-f69d30bbff84 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:36.005252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:36.005779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1224/2431] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:21:36.005938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:36.006389 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:36.006498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:36.009989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:36.016035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:36.017855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7ed47-f47e-452a-99bd-93d643be26ae service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:36.020464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4052c-f25f-418c-b9f2-3bba194d03a4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:36.027093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1208/2432] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:21:36.027353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:36.028668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:36.029082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:36.029407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] PATH_INFO: `/v3/projects/e70d2705021e4e039c09ff5adbc3aff7/users/038104430de94213857398d70f289636/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:36.045872 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70d2705021e4e039c09ff5adbc3aff7, user_id=038104430de94213857398d70f289636, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:36.048555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:36.127961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1225/2433] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:21:36 2022] PUT /identity/v3/projects/e70d2705021e4e039c09ff5adbc3aff7/users/038104430de94213857398d70f289636/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:21:36.139336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:36.139632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:36.139938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:36.196996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] MFA Rules not processed for user `038104430de94213857398d70f289636`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:36.198467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:36.283978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1209/2434] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:36.297402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:36.299454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:36.347562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:36.366561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bff0e-c192-48ad-9f7a-f0a4c6bcdb58 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:36.371365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:36.372216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:36.372695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:36.373184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:36.385991 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:36.388377 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731670e8-78e4-4301-86a3-d5c1747435b9 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:36.399809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1226/2435] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:46.280754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=77 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:46.474649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=9 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:49.901066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:49.902801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:49.990256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e727-02a0-47e8-9671-182f79b24323 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:49.998478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:50.000208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:50.000930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:50.001491 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:50.005709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:50.027231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:50.029071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e889f3-043c-4699-b061-d6a361605e71 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:50.046387 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1210/2436] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:55.552611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:55.553315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:55.553315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:55.554819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1227/2437] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:21:55.561432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7ef3-7ee7-42bd-b853-fd37e56b4744 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:55.562009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7ef3-7ee7-42bd-b853-fd37e56b4744 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:55.562009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7ef3-7ee7-42bd-b853-fd37e56b4744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:55.583077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e87a7ef3-7ee7-42bd-b853-fd37e56b4744 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:55.584439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e87a7ef3-7ee7-42bd-b853-fd37e56b4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:55.594887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1211/2438] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:55.607190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:55.608903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:55.623686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f692bc6-5d61-4442-8627-9248c7b8a0fd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:55.627587 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f04bae4e4cd42b48ff4b6f351fa1bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:55.628271 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:55.628551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:55.628829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:55.640706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:55.644186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d3cd9-ff28-4754-aa56-822c04bc038d service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:55.653361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1228/2439] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:55.883015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:55.883346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:55.883646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] PATH_INFO: `/` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:55.885031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1212/2440] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:21:55.891758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaabf-c4e6-41e9-aaad-0240394e1c23 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:55.892067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaabf-c4e6-41e9-aaad-0240394e1c23 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:55.892328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaabf-c4e6-41e9-aaad-0240394e1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:55.911866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eb1eaabf-c4e6-41e9-aaad-0240394e1c23 None None] MFA Rules not processed for user `2be8d3204196494f9acc8cdf258c2458`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:55.913171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb1eaabf-c4e6-41e9-aaad-0240394e1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:55.972636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1229/2441] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:55.985463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:55.987489 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:56.002138 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba17b48-2ab2-4039-9b9d-2f68854d6bd1 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:56.005718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:56.006356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:56.006637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:56.006913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:56.015065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:56.016493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f9a5a-8687-4b50-aa02-bee65a30e342 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:56.024689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1213/2442] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:56.114624 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8482-f149-4cec-b23f-4de10d80058c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:56.114949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8482-f149-4cec-b23f-4de10d80058c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:56.115222 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd8482-f149-4cec-b23f-4de10d80058c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:56.116597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1230/2443] 10.222.0.60 () {54 vars in 921 bytes} [Mon Jul 11 14:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:21:56.122791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:56.123091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:56.123377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:56.142209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] MFA Rules not processed for user `1e0aca394e4f40c38b3f2db655c462f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:56.143584 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:56.153171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1214/2444] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Jul 11 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:56.164818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd8482-f149-4cec-b23f-4de10d80058c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:56.176873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd8482-f149-4cec-b23f-4de10d80058c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:56.181258 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:56.181879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:56.182741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:56.183064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:56.195145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:56.196584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdaacf-c970-4791-b06d-3c1d83f3472e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:56.207939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1231/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:58.479501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:58.492632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f424df-3786-413e-b882-216b3c6f17e8 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:58.496396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:58.497103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:58.497352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:58.497669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:58.499667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:58.584870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:58.587790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:58.611100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1215/2446] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:59.789930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:59.791442 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:59.791743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:59.818510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:59.819748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:59.888241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1232/2447] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Jul 11 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:59.900292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:59.967766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:59.986400 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb197ad-872e-4836-8339-6071373a6795 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:59.992144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:59.998665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:59.999019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:59.999364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:00.016002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:00.017657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127109d-0134-4991-9998-af0580fcb836 service swift] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:00.027034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1216/2448] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:22:02.619231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:02.641832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc736d2-f346-4c37-891d-2313ecca9c85 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:02.664134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:02.665533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:02.666049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:02.667337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] PATH_INFO: `/v3/users/038104430de94213857398d70f289636` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:02.673945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=038104430de94213857398d70f289636)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:02.676462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:02.991226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038104430de94213857398d70f289636'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:02.992628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038104430de94213857398d70f289636'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.007224 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038104430de94213857398d70f289636'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.038241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038104430de94213857398d70f289636'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.121931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038104430de94213857398d70f289636'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.128874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:03.135952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1233/2449] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:02 2022] DELETE /identity/v3/users/038104430de94213857398d70f289636 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:03.141558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:03.142132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:03.142132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:03.206538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:03.208430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:03.362231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1217/2450] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:03.373204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:03.374905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:03.521374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6f3e4-eb4a-4f74-a414-976fdddcef7b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:03.529851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:03.530757 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:03.531046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:03.531386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:03.548165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:03.550153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:03.563351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:03.564876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:03.574828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1234/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:03.704184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:03.705954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:03.707109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72a4d-2dda-4bc8-b248-a65848b6a28a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:03.733520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:03.739184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:03.741831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:03.742292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:03.743571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5760-5365-4f36-acaa-ee018a055a0c service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:03.745122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:03.757050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:03.757050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:03.757050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:03.757050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] PATH_INFO: `/v3/users/95a0d5d3971a41c1ab6f65b953661393` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:03.761161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a0d5d3971a41c1ab6f65b953661393)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:03.763751 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:03.785832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:03.785832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:03.795370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1218/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:03.972302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a0d5d3971a41c1ab6f65b953661393'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.973436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a0d5d3971a41c1ab6f65b953661393'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:03.983685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a0d5d3971a41c1ab6f65b953661393'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.025889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a0d5d3971a41c1ab6f65b953661393'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.115401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a0d5d3971a41c1ab6f65b953661393'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.124077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1235/2453] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:03 2022] DELETE /identity/v3/users/95a0d5d3971a41c1ab6f65b953661393 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:04.194084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:04.196381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:04.244922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5a492-49d0-410e-91cc-abb2efe2b1b9 service placement] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:04.361980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:04.363148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.363443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.370395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] PATH_INFO: `/v3/projects/e70d2705021e4e039c09ff5adbc3aff7` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.370395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70d2705021e4e039c09ff5adbc3aff7)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:04.370395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:04.401021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:04.533928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:04.536715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:04.566594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35786b72-af6a-4702-af7f-130a177a8b3a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:04.568895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70d2705021e4e039c09ff5adbc3aff7', 'request_id': 'req-0349303d-523e-4bf3-bcc6-a8b5908e7209'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.582529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70d2705021e4e039c09ff5adbc3aff7', 'request_id': 'req-0349303d-523e-4bf3-bcc6-a8b5908e7209'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.675131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:04.676367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.676658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.676939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] PATH_INFO: `/v3/projects/74d319f13b1849f99f34d7f313f375be` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.678257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d319f13b1849f99f34d7f313f375be)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:04.680324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:04.698189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70d2705021e4e039c09ff5adbc3aff7', 'request_id': 'req-0349303d-523e-4bf3-bcc6-a8b5908e7209'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.702061 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:04.715179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] The token cache is being invalidate because project e70d2705021e4e039c09ff5adbc3aff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:04.715488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.718680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0349303d-523e-4bf3-bcc6-a8b5908e7209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.718680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1219/2454] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:04 2022] DELETE /identity/v3/projects/e70d2705021e4e039c09ff5adbc3aff7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:04.723778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152924-2b04-4a39-bba9-e8402c859d57 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.724141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152924-2b04-4a39-bba9-e8402c859d57 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.724527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152924-2b04-4a39-bba9-e8402c859d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.747262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-92152924-2b04-4a39-bba9-e8402c859d57 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:04.748666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-92152924-2b04-4a39-bba9-e8402c859d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:04.758051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1220/2455] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:04.771551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.771898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.772191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.792896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:04.794498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:04.806706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1221/2456] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:04.811665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:04.821690 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ffbb6-db14-4b54-98d2-9811bea7c824 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:04.830624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:04.831780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.832271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.833047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.834222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:04.834776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:04.837241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:04.851606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1222/2457] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:04.855801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:04.867537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f509-6834-412f-b9c6-cf424eb17df7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:04.875444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d319f13b1849f99f34d7f313f375be', 'request_id': 'req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.882232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d319f13b1849f99f34d7f313f375be', 'request_id': 'req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.942909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:04.947249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.947249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.950122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d319f13b1849f99f34d7f313f375be', 'request_id': 'req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.950224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:04.950224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:04.950224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:04.970108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] The token cache is being invalidate because project 74d319f13b1849f99f34d7f313f375be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:04.970444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.971092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ddb3bd35-7d8c-49bb-82d3-fe0ef8805199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:04.973929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1236/2458] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:04 2022] DELETE /identity/v3/projects/74d319f13b1849f99f34d7f313f375be => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:04.979168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cb48-189a-4a04-9926-906cfb0cf2af None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:04.979564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cb48-189a-4a04-9926-906cfb0cf2af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:04.980125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cb48-189a-4a04-9926-906cfb0cf2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.003163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4d50cb48-189a-4a04-9926-906cfb0cf2af None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:05.004462 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d50cb48-189a-4a04-9926-906cfb0cf2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.013849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1237/2459] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:05.022288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768520-4b88-402a-9205-4d13fe668187 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.022721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768520-4b88-402a-9205-4d13fe668187 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.024221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768520-4b88-402a-9205-4d13fe668187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.033178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1223/2460] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:04 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:05.034187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.043737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.049150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-49768520-4b88-402a-9205-4d13fe668187 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:05.050400 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49768520-4b88-402a-9205-4d13fe668187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.126435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd0f0e-ffa7-460e-98e9-c4c0cc066644 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.132431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.133524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.134141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.134641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.135635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.138724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.148196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:05.154635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1238/2461] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:05.159074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768520-4b88-402a-9205-4d13fe668187 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.169102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768520-4b88-402a-9205-4d13fe668187 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.174043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.174712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.175044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.175326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.176058 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:05.176361 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.178078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.193699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1239/2462] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:05.196332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.207335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915693b-6671-4c96-a92f-132ba26a0790 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.212939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.213762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.214153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.214453 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.215237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.217199 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.241614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1224/2463] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:05.246881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.259312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce55c76-e745-49fd-bd81-f01db04a275a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.264838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.265527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.273825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.274415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.275525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.279745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.296040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1225/2464] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:05.297054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.312815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bda71b-454b-4ab2-942f-41c48cdca37c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.317489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1240/2465] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:05.321879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.401436 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20198a-9146-496b-9116-9dca39a5d459 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.412834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.412834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.412834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.412834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.413370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.414888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.415021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.415820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.416162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.416516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.417270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.419845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.425181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:05.448797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1226/2466] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:05.454924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.467231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a383-69db-4cc2-8267-c782fcdcb247 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.472592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.473843 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.476241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.476241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] PATH_INFO: `/v3/projects/38fc77ca9f144d609ef1e4be74c89186/users/6d929d2f72f9479f83e464c5e3b31fb7/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.493357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fc77ca9f144d609ef1e4be74c89186, user_id=6d929d2f72f9479f83e464c5e3b31fb7, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.497384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f2c10-6f48-4e17-b6fe-1366e2041bc0 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.520049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1241/2467] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:05.524422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.536456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215a36f-d2d1-4062-a96a-aac71185f6d3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.542127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.542862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.543573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.543957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.544801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.546777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.558301 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1242/2468] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:05.563053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.578839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c902-53f6-457a-b39b-8b185886fbc1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.584720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.585931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.586307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.586652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.587473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.589248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.601383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1243/2469] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:05.612196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1227/2470] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:05 2022] PUT /identity/v3/projects/38fc77ca9f144d609ef1e4be74c89186/users/6d929d2f72f9479f83e464c5e3b31fb7/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:05.614001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.628159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.628159 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.628494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.643645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d3d19-10ed-4b93-b48e-d345ecea087f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.666778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] MFA Rules not processed for user `6d929d2f72f9479f83e464c5e3b31fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:05.669394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.765539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.766846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.767132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.767415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] PATH_INFO: `/v3/projects/c32941f0f2a74478a53c6a34b07217ef/users/cd80c25fa76d4d3eb73b5ab731963df8/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.797638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32941f0f2a74478a53c6a34b07217ef, user_id=cd80c25fa76d4d3eb73b5ab731963df8, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:05.802131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1228/2471] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:05.806566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cf768-8fee-4ab5-9fc2-6741656e1375 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:05.813693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:05.816556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.893100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:05.894896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1244/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:05 2022] PUT /identity/v3/projects/c32941f0f2a74478a53c6a34b07217ef/users/cd80c25fa76d4d3eb73b5ab731963df8/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:05.906849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.907100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cc39-faad-4f78-815d-8379fb6c3a87 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:05.914141 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.914466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:05.943606 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] MFA Rules not processed for user `cd80c25fa76d4d3eb73b5ab731963df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:05.944879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:05.985844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:05.986828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:05.987184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:05.987565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.032162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1245/2473] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:06.033507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.062632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.064083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.077745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1229/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:06.087873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:06.110395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f496efa-5715-4587-a028-07a3b5a6842a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.115553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.116220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.116669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.116950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.117673 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.119649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.239256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.250558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1246/2475] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:06 2022] POST /identity/v3/projects => generated 357 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:06.254646 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbaf7-02a9-4d34-91d6-760ca84c0ccc service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.330477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.331157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.331593 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.331880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.332634 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.334908 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.476752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1230/2476] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:06 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:06.478114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.489431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3312df-2c19-40f4-b553-6c04bc857ddc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.494340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.495017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.495339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.495634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.496638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.498285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.509720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1247/2477] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:06.518197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.539235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1510d2-a5d2-4eb7-a2cb-75fd363e8c43 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.547039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.548229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.548229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.548771 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] PATH_INFO: `/v3/projects/63a56dd023044edfbff3cacdfc736778/users/794ae6877d884815ac117c8c070c45d7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.568501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a56dd023044edfbff3cacdfc736778, user_id=794ae6877d884815ac117c8c070c45d7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.571281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.670348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1231/2478] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:06 2022] PUT /identity/v3/projects/63a56dd023044edfbff3cacdfc736778/users/794ae6877d884815ac117c8c070c45d7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:06.674558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.685845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba228-393f-488f-a86d-3a1e74d64469 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.748086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.748657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.748945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.749227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.749994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.751726 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93be35-6ecf-4d78-a5c7-d814ffa9cb44 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.764610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1248/2479] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:06.778949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:06.787043 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044069-129d-4ea3-81dc-5fbfdbaf3ac4 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:06.792089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:06.793080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.793434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.793751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] PATH_INFO: `/v3/projects/63a56dd023044edfbff3cacdfc736778/users/794ae6877d884815ac117c8c070c45d7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.795937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a56dd023044edfbff3cacdfc736778, user_id=794ae6877d884815ac117c8c070c45d7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:06.798794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:06.825837 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1232/2480] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:06 2022] PUT /identity/v3/projects/63a56dd023044edfbff3cacdfc736778/users/794ae6877d884815ac117c8c070c45d7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:06.836702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:06.837209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:06.837490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:06.884474 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] MFA Rules not processed for user `794ae6877d884815ac117c8c070c45d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:06.886349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:07.090145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1249/2481] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:06 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:07.100030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:07.107098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:07.200578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce302-1099-4e13-a745-573c9039eb72 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:07.204325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:07.205070 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:07.205428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:07.205845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:07.217331 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:07.218930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16430-ac90-4829-b67f-78d9bc89fc65 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:07.230716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1233/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:07.706649 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:07.717307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88fa5-5dd4-4283-bfdf-786a1026676c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:07.721394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:07.722139 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:07.722423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:07.722724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:07.771532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:07.793216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:07.794990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:07.809971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1250/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:16.375154 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:16.382464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:16.382464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:16.395217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] MFA Rules not processed for user `a4467c612a534ae9871d4a6579e19bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:16.396472 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:16.452438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1234/2484] 10.222.0.60 () {58 vars in 967 bytes} [Mon Jul 11 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:16.476397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:16.477986 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:16.569644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dce3-3757-4828-82e2-4d5fcc3010e7 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:16.576878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd459c85484c843f9ad25f90d76d0a634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:16.578052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:16.579647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:16.579647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:16.590333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:16.592113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:16.601331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1251/2485] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Jul 11 14:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:22:23.180596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:23.182545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:23.264720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3bda-c793-484f-afec-1027742fea79 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:23.268401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:23.269072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:23.269351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:23.269663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:23.271518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:23.342418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:23.343913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:23.355160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1235/2486] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:26.599290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=42 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:27.255235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:27.255235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:27.348084 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9ed09-dcc6-46b7-b4a2-f69d506a05c4 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:27.353595 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:27.354283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:27.354579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:27.354837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:27.357488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:27.376706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:27.378187 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:27.391612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1252/2487] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:27.404804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:27.407797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:27.414937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:27.421998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf957f-f752-419e-8e96-712649c776c8 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:27.429818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:27.429818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:27.429818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:27.429818 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] PATH_INFO: `/v3/users/8b273bb179aa4dc987fd7f67c7131724` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:27.431075 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b273bb179aa4dc987fd7f67c7131724)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:27.433941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:27.705524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b273bb179aa4dc987fd7f67c7131724'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:27.715917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b273bb179aa4dc987fd7f67c7131724'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:27.716665 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b273bb179aa4dc987fd7f67c7131724'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:27.732857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b273bb179aa4dc987fd7f67c7131724'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:27.812512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-51846ec2-d5da-4a0a-b144-7523d93481f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b273bb179aa4dc987fd7f67c7131724'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:27.819226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1236/2488] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:27 2022] DELETE /identity/v3/users/8b273bb179aa4dc987fd7f67c7131724 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:28.076032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.093428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480889dd-e497-47f6-886f-488f1b16b5c1 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.156178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.157094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.157380 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.157694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] PATH_INFO: `/v3/projects/9fc4170d9d79448b81de3b7638c1a3a7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.159011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc4170d9d79448b81de3b7638c1a3a7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.160995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.287581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc4170d9d79448b81de3b7638c1a3a7', 'request_id': 'req-ba493624-a03f-434b-81b0-3448334dfffc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:28.293314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc4170d9d79448b81de3b7638c1a3a7', 'request_id': 'req-ba493624-a03f-434b-81b0-3448334dfffc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:28.370488 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc4170d9d79448b81de3b7638c1a3a7', 'request_id': 'req-ba493624-a03f-434b-81b0-3448334dfffc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:28.383033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] The token cache is being invalidate because project 9fc4170d9d79448b81de3b7638c1a3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:28.383324 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:28.383961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba493624-a03f-434b-81b0-3448334dfffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:28.385614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1253/2489] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:28 2022] DELETE /identity/v3/projects/9fc4170d9d79448b81de3b7638c1a3a7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:28.391444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.391722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.392005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.413829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:28.415135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:28.477640 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1237/2490] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:28.485806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.486098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.486375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.507315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:28.508786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:28.517638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1254/2491] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:28.521922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.532240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae20f6-fa8f-4026-8a30-7dece6185233 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.536983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.537672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.537961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.538238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.538975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:28.539266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.540989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.553620 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1238/2492] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:22:28.558627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.568729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe961-e1eb-4aab-9567-92a754ca80a5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.573460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.574897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.575179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.575455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.576154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.578146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.588760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:28.685079 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1255/2493] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:28.689487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.700564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02c55-67b6-4c5a-b696-e420f7f02c84 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.770300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.771122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.771379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.771713 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.772802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.777338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.784090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:28.853445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1239/2494] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:28 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:28.858270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.871645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a4d3-195e-47bc-94b1-e51c24b5c862 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.876905 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.877503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.877821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.878096 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.878846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.880495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.892588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1256/2495] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:28.896648 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.911652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c56d9-02f4-4b6a-8abd-e1ae10f592f6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.916488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.917160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.918100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.918553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.919352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.921084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f7c37-a1c8-4e30-96ef-c4817368691b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:28.932333 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1240/2496] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:28.937369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:28.947998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f560f-0641-4b15-8e6f-624da23787ba admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:28.953669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:28.954585 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:28.954869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:28.955147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] PATH_INFO: `/v3/projects/3bb372e7c7444fa0977ae43f95d4efd5/users/0c476eca93584c188463ae9da6620733/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:28.970544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb372e7c7444fa0977ae43f95d4efd5, user_id=0c476eca93584c188463ae9da6620733, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:28.975517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:29.059403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1257/2497] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:28 2022] PUT /identity/v3/projects/3bb372e7c7444fa0977ae43f95d4efd5/users/0c476eca93584c188463ae9da6620733/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:29.070819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:29.071112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:29.071398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:29.101451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] MFA Rules not processed for user `0c476eca93584c188463ae9da6620733`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:29.102754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:29.174280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1241/2498] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:29.191093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:29.192817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:29.271248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf2c31-65f7-4977-a1e0-667f7a7fd9cb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:29.277623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:29.278423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:29.278727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:29.279000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:29.291903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:29.294240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0d869-1d23-40c8-b360-87cd07c530b1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:29.304981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1258/2499] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:30.427153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:30.428675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:30.501185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a293-3e31-4a49-94df-5fe3a9a493cb None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:30.505864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:30.506757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:30.507044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:30.507324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] PATH_INFO: `/v3/users/cd80c25fa76d4d3eb73b5ab731963df8` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:30.508523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd80c25fa76d4d3eb73b5ab731963df8)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:30.510488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:30.756255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd80c25fa76d4d3eb73b5ab731963df8'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:30.763626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd80c25fa76d4d3eb73b5ab731963df8'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:30.764318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd80c25fa76d4d3eb73b5ab731963df8'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:30.777523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:30.779428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd80c25fa76d4d3eb73b5ab731963df8'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:30.886670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd80c25fa76d4d3eb73b5ab731963df8'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:30.894356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1242/2500] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:30 2022] DELETE /identity/v3/users/cd80c25fa76d4d3eb73b5ab731963df8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:30.899059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:30.899569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:30.899671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:30.918343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:30.919566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:30.980779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1259/2501] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:30.990616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:30.992082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:31.056263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a43b-4d30-41e6-988f-174a8697208d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:31.060237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:31.060894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:31.061184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:31.061460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:31.070982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:31.072434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:31.083268 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1243/2502] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:31.569131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:31.571008 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:31.592580 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb7921-0122-4e06-a59d-e3a889b64b6b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:31.599016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:31.599829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:31.600106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:31.600452 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] PATH_INFO: `/v3/projects/c32941f0f2a74478a53c6a34b07217ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:31.602083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32941f0f2a74478a53c6a34b07217ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:31.603956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:31.751570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:31.760656 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32941f0f2a74478a53c6a34b07217ef', 'request_id': 'req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:31.767817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32941f0f2a74478a53c6a34b07217ef', 'request_id': 'req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:31.858176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32941f0f2a74478a53c6a34b07217ef', 'request_id': 'req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:31.871828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] The token cache is being invalidate because project c32941f0f2a74478a53c6a34b07217ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:31.872158 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:31.872796 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:31.875143 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1260/2503] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:31 2022] DELETE /identity/v3/projects/c32941f0f2a74478a53c6a34b07217ef => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:31.879416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:31.890273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ccf0-1596-4d8f-8290-dfc1c127847e service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:31.957738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:31.958660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:31.958924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:31.959209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] PATH_INFO: `/v3/users/794ae6877d884815ac117c8c070c45d7` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:31.960660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=794ae6877d884815ac117c8c070c45d7)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:31.962722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:32.152969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794ae6877d884815ac117c8c070c45d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:32.160122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794ae6877d884815ac117c8c070c45d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:32.160794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794ae6877d884815ac117c8c070c45d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:32.173869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794ae6877d884815ac117c8c070c45d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:32.246657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794ae6877d884815ac117c8c070c45d7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:32.253131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1244/2504] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:31 2022] DELETE /identity/v3/users/794ae6877d884815ac117c8c070c45d7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:32.781886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:32.781886 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:32.783867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:32.789027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:32.800005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a7e6-9886-4272-abf8-f4905d8cd23c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:32.818993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:32.894226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:32.894226 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:32.894705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:32.894705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] PATH_INFO: `/v3/projects/63a56dd023044edfbff3cacdfc736778` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:32.898121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a56dd023044edfbff3cacdfc736778)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:32.900770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:32.923851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257274e-2c1d-463e-a1b0-501aeebcd58b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:32.931757 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:32.933057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:32.934112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:32.934638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] PATH_INFO: `/v3/users/0c476eca93584c188463ae9da6620733` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:32.936477 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c476eca93584c188463ae9da6620733)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:32.939609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.064884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a56dd023044edfbff3cacdfc736778', 'request_id': 'req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.070548 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a56dd023044edfbff3cacdfc736778', 'request_id': 'req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.184622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a56dd023044edfbff3cacdfc736778', 'request_id': 'req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.196780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] The token cache is being invalidate because project 63a56dd023044edfbff3cacdfc736778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:33.197112 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.197808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39950ed4-86b6-4e8d-991f-7dd739ce5e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.200369 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1261/2505] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:32 2022] DELETE /identity/v3/projects/63a56dd023044edfbff3cacdfc736778 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:33.205553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15e0-841a-47ff-bc0d-93e098c47bc7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.205883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15e0-841a-47ff-bc0d-93e098c47bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.206166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15e0-841a-47ff-bc0d-93e098c47bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.224185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c476eca93584c188463ae9da6620733'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.228691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-92bc15e0-841a-47ff-bc0d-93e098c47bc7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:33.230808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-92bc15e0-841a-47ff-bc0d-93e098c47bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:33.232596 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c476eca93584c188463ae9da6620733'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.233336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c476eca93584c188463ae9da6620733'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.247109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c476eca93584c188463ae9da6620733'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.281761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:33.295661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1262/2506] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:33.303393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.303705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.303988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.310030 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0384b7ad-3c33-4c30-bcda-dce9c8abac8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c476eca93584c188463ae9da6620733'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:33.316851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1245/2507] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:32 2022] DELETE /identity/v3/users/0c476eca93584c188463ae9da6620733 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:33.321231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.321530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.321895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.327089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:33.328306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:33.339236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:33.340652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:33.395652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1263/2508] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:33.399946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.408727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1246/2509] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:33.409094 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c0c11-9c4c-462e-b9ec-3bcdb7622a5e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.413783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.414439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.414721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.414995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.415712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:33.416016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.418231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.419302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.421876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:33.435408 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1264/2510] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:22:33.436679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.446877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e6eb-a9e0-481d-94c2-4ded6cc6b17b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.451978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.452640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.453017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.453228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.453911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.455806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.456862 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:33.485265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc1303-7935-4463-8642-601d1e71ab52 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.489605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.490358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.490647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.490997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.501719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.503155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.513000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1247/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:33.543398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1265/2512] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:33.545021 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.555998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb032-52cc-4c7c-917c-a900426d6edf service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.622292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.622962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.623245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.623521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.624210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.626152 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.705149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1248/2513] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:33.709065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.721053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ab4e-3b60-4c4e-a5cd-9e6fb15b354d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.725988 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.726306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.726572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.726980 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.727731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.729525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.740938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1266/2514] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:33.745051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.756780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d3c0-41c6-4286-86cd-e559f5bfe003 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.762321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.763007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.763295 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.766591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.766591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.766591 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d0e37-e8fb-4c50-a280-32f17b5fe7ad admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.778552 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1249/2515] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:33.782857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.795395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8534-eaab-4e70-a3fe-fab17e2a905d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:33.798805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:33.799791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.800073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.800356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] PATH_INFO: `/v3/projects/152ea86a58b745729fee617af2b3d5f4/users/702695572f6b4fefa796268de5298992/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.816894 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152ea86a58b745729fee617af2b3d5f4, user_id=702695572f6b4fefa796268de5298992, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:33.819644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:33.916856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1267/2516] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:33 2022] PUT /identity/v3/projects/152ea86a58b745729fee617af2b3d5f4/users/702695572f6b4fefa796268de5298992/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:33.931305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:33.931861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:33.931861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:33.948126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:33.953234 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:33.966020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] MFA Rules not processed for user `702695572f6b4fefa796268de5298992`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:33.971206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.030949 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2ae0-f200-41c2-9464-06e7f4b4fa21 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.039914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.041370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.041696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.042006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] PATH_INFO: `/v3/projects/3bb372e7c7444fa0977ae43f95d4efd5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.044082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb372e7c7444fa0977ae43f95d4efd5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.047526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.073044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1250/2517] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:34.077652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.088751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277cf3-8a81-4527-9bc6-331276f38c05 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.093684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.096234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.096234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.096234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.096234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.097848 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.196292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:34.211189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb372e7c7444fa0977ae43f95d4efd5', 'request_id': 'req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:34.216719 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb372e7c7444fa0977ae43f95d4efd5', 'request_id': 'req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:34.263494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1251/2518] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:34.267435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.290225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:34.330940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff3da-909d-4a1b-a00e-9f49a4f9ee6c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.336174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.342310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.342310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.342310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.342310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.342310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.364356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb372e7c7444fa0977ae43f95d4efd5', 'request_id': 'req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:34.378312 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] The token cache is being invalidate because project 3bb372e7c7444fa0977ae43f95d4efd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:34.378608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:34.379336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6ab64c32-9701-45c1-82df-e18a1ab0b3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:34.380998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1268/2519] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:33 2022] DELETE /identity/v3/projects/3bb372e7c7444fa0977ae43f95d4efd5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:34.385840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5b3-5ce0-46cf-99af-e51ed5b52b3f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.386254 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5b3-5ce0-46cf-99af-e51ed5b52b3f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.386705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5b3-5ce0-46cf-99af-e51ed5b52b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.404884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9619a5b3-5ce0-46cf-99af-e51ed5b52b3f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:34.406127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9619a5b3-5ce0-46cf-99af-e51ed5b52b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.414215 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1269/2520] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:34.421820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.422108 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.422385 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.441887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:34.443220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.445734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1252/2521] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:34.450727 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.452345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.455710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1270/2522] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:34.459795 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.465889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcab8-e63d-4c9c-b738-298b1a85c34a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.470617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc96ef-7c9e-4c6d-bcac-4db73708243d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.474553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.474553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.474553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.474553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.474940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.474940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.475367 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.476029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.476316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.476605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.477353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:34.477695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.479307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.484879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1253/2523] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:34.491121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.491966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1271/2524] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:34.499091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.507490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45fdf1-8e75-401c-812c-24975fcfb8db admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.515322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.517920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd395c5-e921-4373-9da4-f2ab05dec6b8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.518033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.518033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.518033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] PATH_INFO: `/v3/projects/4dd9152d0dc04538bd27b7088081098d/users/164a9e38c1e04224a9aa47ad161a4aeb/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.523105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.524009 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.524468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.525045 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.526239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.529707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.540782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd9152d0dc04538bd27b7088081098d, user_id=164a9e38c1e04224a9aa47ad161a4aeb, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.543667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.642561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1254/2525] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:34 2022] PUT /identity/v3/projects/4dd9152d0dc04538bd27b7088081098d/users/164a9e38c1e04224a9aa47ad161a4aeb/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:34.646947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.676487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1272/2526] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:34.681003 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.714517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b683c5d-0c44-4ca8-a05e-5181b92437ec admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.745353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcac3c-a525-40d4-ba83-78854df14806 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.750841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.751532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.751831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.752106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.752800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.754805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.782050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.782762 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.783048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.783329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.784102 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.785749 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.796795 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1255/2527] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:34.800553 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.810986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0081cb7-2c43-4a25-8197-c05172999e36 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.815940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.816737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.817027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.817311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] PATH_INFO: `/v3/projects/4dd9152d0dc04538bd27b7088081098d/users/164a9e38c1e04224a9aa47ad161a4aeb/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.819330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd9152d0dc04538bd27b7088081098d, user_id=164a9e38c1e04224a9aa47ad161a4aeb, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.822115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70346d0f-e98f-472a-ac32-f5263a781fd7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.833013 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1256/2528] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:34 2022] PUT /identity/v3/projects/4dd9152d0dc04538bd27b7088081098d/users/164a9e38c1e04224a9aa47ad161a4aeb/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:34.845236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.845527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.850351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.852694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:34.874254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] MFA Rules not processed for user `164a9e38c1e04224a9aa47ad161a4aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:34.875898 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.877179 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1273/2529] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:34.881498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.893277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6911b-1cf6-40b5-b639-31cc6adde268 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.949117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:34.955709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:34.956428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:34.956714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:34.957022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:34.957874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:34.959054 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1257/2530] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:34.959690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:34.974470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.975372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:34.979967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1274/2531] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:34.981237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:34.994093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc985-37ee-4a93-8484-b9254618acf3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:34.999220 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:35.000627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:35.000627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:35.000627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:35.001205 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:35.002762 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:35.017705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1275/2532] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:35.018915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:35.031343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde84ef2-61f4-4e34-a5df-7f7b71d328bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:35.036236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:35.037128 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:35.037410 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:35.037857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] PATH_INFO: `/v3/projects/70d3c2a902db4909a930277a14175b04/users/edf0017342cf4ea9815b74de58fe5b1f/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:35.050978 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb0945-f34c-45dc-af84-41a1af00dba2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:35.053313 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d3c2a902db4909a930277a14175b04, user_id=edf0017342cf4ea9815b74de58fe5b1f, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:35.054600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:35.055282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:35.055568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:35.055847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:35.056035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd9944-84d5-4626-9afe-e34d822108fa admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:35.057808 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:35.124781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:35.130015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:35.130119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1276/2533] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:35 2022] PUT /identity/v3/projects/70d3c2a902db4909a930277a14175b04/users/edf0017342cf4ea9815b74de58fe5b1f/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:35.136805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1258/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:35.140455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:35.140749 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:35.141029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:35.170275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] MFA Rules not processed for user `edf0017342cf4ea9815b74de58fe5b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:35.171391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:35.257924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1277/2535] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:35.269664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:35.271299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:35.282524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078e9ac-5fe0-49e0-9faf-b11f0e28912c service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:35.329734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:35.337287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:35.337987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:35.338276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:35.338557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:35.347064 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:35.351100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:35.357571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1259/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:36.879026 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:36.890496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b328f8-6eae-45bd-ae2b-a089decc716c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:36.894297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:36.894982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:36.895266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:36.895549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:36.969525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:36.971153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7e921-f7a5-4116-9840-150b0571e252 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:36.983021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1278/2537] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:42.535752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:42.608336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd7882-1a50-4a84-9dbf-10ffcce89e5d service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:42.613374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:42.614375 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:42.614803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:42.615100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] PATH_INFO: `/v3/users/702695572f6b4fefa796268de5298992` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:42.616334 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] RBAC: Authorizing `identity:delete_user(user_id=702695572f6b4fefa796268de5298992)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:42.618316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:42.891779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702695572f6b4fefa796268de5298992'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:42.900097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702695572f6b4fefa796268de5298992'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:42.901077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702695572f6b4fefa796268de5298992'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:42.921374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702695572f6b4fefa796268de5298992'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:42.999059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702695572f6b4fefa796268de5298992'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:43.006354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1260/2538] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:42 2022] DELETE /identity/v3/users/702695572f6b4fefa796268de5298992 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:43.012768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:43.013232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:43.014056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:43.032280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:43.033430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:43.076001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:43.101167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1279/2539] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:43.111622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:43.113123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:43.177930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097f85-b946-4d7a-9439-116eb8a137da admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:43.181785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:43.182442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:43.186300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:43.186300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:43.197999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:43.200085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:43.212061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1261/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:43.716875 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:43.718579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:43.732978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727b523-3dbe-4136-8705-07e4be47d61f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:43.743538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:43.747506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:43.748050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:43.748825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] PATH_INFO: `/v3/projects/152ea86a58b745729fee617af2b3d5f4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:43.751783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=152ea86a58b745729fee617af2b3d5f4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:43.755831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:43.907506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152ea86a58b745729fee617af2b3d5f4', 'request_id': 'req-900eabe1-781f-490a-8fc1-4da99423c525'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:43.920516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152ea86a58b745729fee617af2b3d5f4', 'request_id': 'req-900eabe1-781f-490a-8fc1-4da99423c525'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:43.999004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152ea86a58b745729fee617af2b3d5f4', 'request_id': 'req-900eabe1-781f-490a-8fc1-4da99423c525'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.012161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] The token cache is being invalidate because project 152ea86a58b745729fee617af2b3d5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:44.012889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.013480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.014840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1280/2541] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:43 2022] DELETE /identity/v3/projects/152ea86a58b745729fee617af2b3d5f4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:44.019084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:44.030082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432bd2-1851-4ce3-9542-75b602633190 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:44.035352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:44.095163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:44.096082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:44.096411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:44.096716 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] PATH_INFO: `/v3/users/164a9e38c1e04224a9aa47ad161a4aeb` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:44.097987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=164a9e38c1e04224a9aa47ad161a4aeb)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:44.099955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:44.288738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164a9e38c1e04224a9aa47ad161a4aeb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.297807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164a9e38c1e04224a9aa47ad161a4aeb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.298607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164a9e38c1e04224a9aa47ad161a4aeb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.312143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164a9e38c1e04224a9aa47ad161a4aeb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.400753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-0b204f7e-5a9a-49be-8ab3-1686827944cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164a9e38c1e04224a9aa47ad161a4aeb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:44.409145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1262/2542] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:44 2022] DELETE /identity/v3/users/164a9e38c1e04224a9aa47ad161a4aeb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:44.888386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:44.889861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:44.908971 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eabe1-781f-490a-8fc1-4da99423c525 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:44.968073 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:44.969017 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:44.969305 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:44.969598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] PATH_INFO: `/v3/projects/4dd9152d0dc04538bd27b7088081098d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:44.970831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd9152d0dc04538bd27b7088081098d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:44.972761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.162131 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd9152d0dc04538bd27b7088081098d', 'request_id': 'req-6729e63e-2c16-494e-8cf1-dc39419ba183'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:45.167957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd9152d0dc04538bd27b7088081098d', 'request_id': 'req-6729e63e-2c16-494e-8cf1-dc39419ba183'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:45.315242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd9152d0dc04538bd27b7088081098d', 'request_id': 'req-6729e63e-2c16-494e-8cf1-dc39419ba183'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:45.317695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:45.332506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] The token cache is being invalidate because project 4dd9152d0dc04538bd27b7088081098d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:45.332506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:45.332506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6729e63e-2c16-494e-8cf1-dc39419ba183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:45.334186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1281/2543] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:44 2022] DELETE /identity/v3/projects/4dd9152d0dc04538bd27b7088081098d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:45.339097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.339540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.339767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.358409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:45.359651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:45.422410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1263/2544] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:45.430117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.430346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.430628 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.451319 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:45.452528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:45.464916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1282/2545] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:45.466243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.476579 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca666-65d3-461d-b262-b41a77950f26 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.482245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.482952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.483241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.483522 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.484313 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:45.484624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.486335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.499652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1264/2546] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:22:45.504225 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.513828 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704a878-ecd9-4cbd-abbe-5362c8be705c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.518532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.519318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.519615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.519866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.520586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.522535 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.619945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1283/2547] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:45 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:45.624330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.634590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04ff6-18ce-47b0-a077-2f1512be82a3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.646589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:45.695248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.695836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.696119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.696409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.697098 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.699357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.822532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1265/2548] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:45 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:45.827517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.838208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149506fc-47b4-4996-86a5-e01ebb9fc433 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.846752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.847451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.847818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.848836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.849127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.851355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.865278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1284/2549] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:45.871018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.886201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023da6e-cf0e-4ae2-b174-a9f64bfca2c5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.891675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.899518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.899518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.899518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.899518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.899518 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf9ab6-8398-476e-8f2a-f085f9d5f8df admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:45.909347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1266/2550] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:45.915559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:45.926741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe92f1-618d-40ae-bd25-0fc276322c4e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:45.931482 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:45.932368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:45.932652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:45.933132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] PATH_INFO: `/v3/projects/7d8523ef1b04481e888211d5ea173926/users/2a3796dc88ec4f0397f89c7392c8f2c8/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:45.957722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8523ef1b04481e888211d5ea173926, user_id=2a3796dc88ec4f0397f89c7392c8f2c8, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:45.957722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.065844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1285/2551] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:45 2022] PUT /identity/v3/projects/7d8523ef1b04481e888211d5ea173926/users/2a3796dc88ec4f0397f89c7392c8f2c8/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:46.078878 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.079171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.079497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.108409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] MFA Rules not processed for user `2a3796dc88ec4f0397f89c7392c8f2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:46.109130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:46.181798 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1267/2552] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:46.186661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.261566 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1af2-7355-417f-a424-7c64c7747e31 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.266725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.267431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.267714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.267989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.268723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.270703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.357644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1286/2553] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:46 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:46.362201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.375135 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31fa0a-9c3a-4385-baa3-429e7475cf38 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.410804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.412718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:46.442912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.443637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.444060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.444345 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.445059 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.447097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.483693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe01dd4-72b7-48c2-b3bb-48cf0f8fa174 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.489006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.489943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.490227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.490502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] PATH_INFO: `/v3/users/6d929d2f72f9479f83e464c5e3b31fb7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.491715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d929d2f72f9479f83e464c5e3b31fb7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.493681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.517845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:46.595668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1268/2554] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:46 2022] POST /identity/v3/users => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:46.599653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.610085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdda95-781d-4c30-b0e8-4ca01b8593bd admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.614981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.615632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.615957 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.616469 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.616975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.618692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.633468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1269/2555] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:46.634879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.641219 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:46.646497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321b23-9ef0-4709-9de6-def94e648310 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.651372 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.652612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.652897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.653184 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] PATH_INFO: `/v3/projects/b7eb39461f9545fda3863d6f49bfd642/users/da81a88a12314bf98ded07962f6d34f7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.668870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7eb39461f9545fda3863d6f49bfd642, user_id=da81a88a12314bf98ded07962f6d34f7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.671689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.706731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d929d2f72f9479f83e464c5e3b31fb7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:46.707601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d929d2f72f9479f83e464c5e3b31fb7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:46.715276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d929d2f72f9479f83e464c5e3b31fb7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:46.727511 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d929d2f72f9479f83e464c5e3b31fb7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:46.741944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1270/2556] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:46 2022] PUT /identity/v3/projects/b7eb39461f9545fda3863d6f49bfd642/users/da81a88a12314bf98ded07962f6d34f7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:46.747034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.783861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ba66617c-7ab4-42a4-b598-da89651a1328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d929d2f72f9479f83e464c5e3b31fb7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:46.790661 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1287/2557] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:46 2022] DELETE /identity/v3/users/6d929d2f72f9479f83e464c5e3b31fb7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:46.795800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.796091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.796434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.815298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e613d7-81f1-48ad-8ab6-4033b57f1ddc admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.816050 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:46.817277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:46.876614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.877406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.877796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.878149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.878956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.880573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1288/2558] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:46.880700 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.890786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.892292 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:46.893956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1271/2559] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:46.898012 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:46.899736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:46.913281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e15c4-ca73-46d4-9c87-cb61f254b167 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.918753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:46.919637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.919920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.920194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] PATH_INFO: `/v3/projects/b7eb39461f9545fda3863d6f49bfd642/users/da81a88a12314bf98ded07962f6d34f7/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.922352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7eb39461f9545fda3863d6f49bfd642, user_id=da81a88a12314bf98ded07962f6d34f7, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:46.925007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24e55c-fc13-43d8-99f1-967cf21f4b8d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:46.936742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1272/2560] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:46 2022] PUT /identity/v3/projects/b7eb39461f9545fda3863d6f49bfd642/users/da81a88a12314bf98ded07962f6d34f7/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:46.947193 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:46.949196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:46.949196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:46.958281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598db1b1-b837-4782-a8a8-a4780df22a64 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:46.975422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] MFA Rules not processed for user `da81a88a12314bf98ded07962f6d34f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:46.976703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.011264 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.011918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.012198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.012690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.018203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:47.040783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:47.052142 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1273/2561] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:47.063864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:47.065274 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.075802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:47.078033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:47.088495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1289/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:47.125218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a296-fcf5-4d4b-847b-240fbf3b6e18 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:47.128869 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.129529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.129840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.130117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.139970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:47.141608 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:47.152439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1274/2563] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:47.291513 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:47.313396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582a9e6-8d97-4961-b208-721f36ca2b37 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:47.323457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.324502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.324893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.325126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] PATH_INFO: `/v3/users/2a3796dc88ec4f0397f89c7392c8f2c8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.326281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3796dc88ec4f0397f89c7392c8f2c8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:47.328218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:47.474394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:47.475949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.495927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e062-063d-47f8-8c9c-a3517a357b62 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:47.502559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.503454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.503739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.503986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] PATH_INFO: `/v3/projects/38fc77ca9f144d609ef1e4be74c89186` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.505209 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fc77ca9f144d609ef1e4be74c89186)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:47.507239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:47.552398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3796dc88ec4f0397f89c7392c8f2c8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.552970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3796dc88ec4f0397f89c7392c8f2c8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.561069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3796dc88ec4f0397f89c7392c8f2c8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.573407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3796dc88ec4f0397f89c7392c8f2c8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.602172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fc77ca9f144d609ef1e4be74c89186', 'request_id': 'req-b24773e0-b8b6-4453-ac23-b71b664b107b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.609286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fc77ca9f144d609ef1e4be74c89186', 'request_id': 'req-b24773e0-b8b6-4453-ac23-b71b664b107b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.720989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6b744c65-f6c7-4d11-81a5-a8e7c704a8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3796dc88ec4f0397f89c7392c8f2c8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.727521 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1290/2564] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:47 2022] DELETE /identity/v3/users/2a3796dc88ec4f0397f89c7392c8f2c8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:47.732556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.732844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.733126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.751192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:47.752711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.816493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1291/2565] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:47.817405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:47.818703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.831173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b731b65-8272-4b2a-983a-dd3cf26dc1e9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:47.836069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.836926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.837204 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.837477 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] PATH_INFO: `/v3/users/edf0017342cf4ea9815b74de58fe5b1f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.838692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf0017342cf4ea9815b74de58fe5b1f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:47.841353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:47.846434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fc77ca9f144d609ef1e4be74c89186', 'request_id': 'req-b24773e0-b8b6-4453-ac23-b71b664b107b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.853627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:47.859174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] The token cache is being invalidate because project 38fc77ca9f144d609ef1e4be74c89186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:47.859468 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.860181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:47.861782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1275/2566] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:47 2022] DELETE /identity/v3/projects/38fc77ca9f144d609ef1e4be74c89186 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:47.862554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:47.863914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:47.935937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24773e0-b8b6-4453-ac23-b71b664b107b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:47.975801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:47.995899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:47.996564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:47.996873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:47.997148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:47.999435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:48.013085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:48.014903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8a66-4644-4101-9ff5-63bc30983761 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:48.026439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1276/2567] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:48.101743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf0017342cf4ea9815b74de58fe5b1f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.102646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf0017342cf4ea9815b74de58fe5b1f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.110877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf0017342cf4ea9815b74de58fe5b1f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.126191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf0017342cf4ea9815b74de58fe5b1f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.206256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf0017342cf4ea9815b74de58fe5b1f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.213614 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1292/2568] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:47 2022] DELETE /identity/v3/users/edf0017342cf4ea9815b74de58fe5b1f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:48.219004 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:48.219310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:48.219589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:48.237410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:48.238810 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:48.303774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1277/2569] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:48.314266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:48.315867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:48.382792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82280dea-0505-49d5-8f62-61dc24f27655 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:48.386834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:48.387536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:48.387799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:48.388077 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:48.399150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:48.400655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:48.413524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1293/2570] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:48.748744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:48.750342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:48.763676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823dd07-de4b-4177-b883-a17f4ee0085a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:48.770106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:48.770993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:48.771298 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:48.771577 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] PATH_INFO: `/v3/projects/7d8523ef1b04481e888211d5ea173926` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:48.772812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8523ef1b04481e888211d5ea173926)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:48.774922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:48.903599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:48.906021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:48.917127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8523ef1b04481e888211d5ea173926', 'request_id': 'req-1d8bd13e-ebce-4efc-a91f-13e103beb029'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.924769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8523ef1b04481e888211d5ea173926', 'request_id': 'req-1d8bd13e-ebce-4efc-a91f-13e103beb029'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.925261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf1a8-704c-484e-b52e-9ef386766f12 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:48.983446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8523ef1b04481e888211d5ea173926', 'request_id': 'req-1d8bd13e-ebce-4efc-a91f-13e103beb029'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.985837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:48.986708 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:48.986990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:48.987266 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] PATH_INFO: `/v3/projects/70d3c2a902db4909a930277a14175b04` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:48.988532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d3c2a902db4909a930277a14175b04)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:48.990494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:48.996039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] The token cache is being invalidate because project 7d8523ef1b04481e888211d5ea173926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:48.996341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.997092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:48.998805 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1278/2571] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:48 2022] DELETE /identity/v3/projects/7d8523ef1b04481e888211d5ea173926 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:49.002820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.005103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:49.018984 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd13e-ebce-4efc-a91f-13e103beb029 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.023860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.024734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.025115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.025308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] PATH_INFO: `/v3/users/da81a88a12314bf98ded07962f6d34f7` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.026615 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da81a88a12314bf98ded07962f6d34f7)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.028546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.102059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:49.113992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d3c2a902db4909a930277a14175b04', 'request_id': 'req-c334ccfc-3c58-4d48-ac49-091404a13729'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.119354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d3c2a902db4909a930277a14175b04', 'request_id': 'req-c334ccfc-3c58-4d48-ac49-091404a13729'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.240966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d3c2a902db4909a930277a14175b04', 'request_id': 'req-c334ccfc-3c58-4d48-ac49-091404a13729'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.252956 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] The token cache is being invalidate because project 70d3c2a902db4909a930277a14175b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:49.253427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.254007 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c334ccfc-3c58-4d48-ac49-091404a13729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.255597 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1294/2572] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:48 2022] DELETE /identity/v3/projects/70d3c2a902db4909a930277a14175b04 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:49.259433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da81a88a12314bf98ded07962f6d34f7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.260434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474eed-8aac-426d-85f3-b92db9fbde42 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.260725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474eed-8aac-426d-85f3-b92db9fbde42 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.261037 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474eed-8aac-426d-85f3-b92db9fbde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.268519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da81a88a12314bf98ded07962f6d34f7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.269229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da81a88a12314bf98ded07962f6d34f7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.270533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:49.281340 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-41474eed-8aac-426d-85f3-b92db9fbde42 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:49.282583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-41474eed-8aac-426d-85f3-b92db9fbde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:49.283778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da81a88a12314bf98ded07962f6d34f7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.343582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1295/2573] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:49.351196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.351494 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.351773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.370690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:49.371898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:49.380758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1296/2574] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:49.384854 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.393566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da81a88a12314bf98ded07962f6d34f7'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:49.394978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a26816-053b-4031-a1b1-53338ee2a901 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.400038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.400511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1279/2575] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:49 2022] DELETE /identity/v3/users/da81a88a12314bf98ded07962f6d34f7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:49.400715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.400976 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.401282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.402124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:49.402421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.404533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.416529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1297/2576] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:49.421296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.422943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:49.493410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c8e5-4936-473a-ac99-2ec19e76af62 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.499107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.499714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.500126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.500406 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.501116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.503063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.614670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1280/2577] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:49 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:49.618941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.629923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4e339-920f-4e61-bbc4-d946c3fe4137 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.689236 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.689938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.690223 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.690498 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.691263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.693182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.788021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1298/2578] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:49 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:49.791937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.803515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd328a-d6a0-445d-b366-793625fb72e8 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.808537 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.809157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.809461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.809792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.811052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.812707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.823884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1281/2579] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:49.828106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.838640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddc870-dbe9-44eb-8ce7-7514a14e1ed2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.843471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.844135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.844426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.848888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.848888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.848888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.857742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1299/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:49.861996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.874736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0058e-ccea-4530-8127-0a0b47805591 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.879054 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:49.881065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:49.886024 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.886976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.887260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.887559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] PATH_INFO: `/v3/projects/663d9aea3dbc453cb62d35157bd61c6d/users/a85490e09bc04b7997c8c24a41af29a0/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.905723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=663d9aea3dbc453cb62d35157bd61c6d, user_id=a85490e09bc04b7997c8c24a41af29a0, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.909035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d185b7-f794-443d-9fb5-941c3a6ccd4e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.913140 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128fa6b-0c91-41ee-95b4-63803990fea0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:49.918116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:49.919000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:49.919283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:49.920423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] PATH_INFO: `/v3/projects/b7eb39461f9545fda3863d6f49bfd642` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:49.921683 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7eb39461f9545fda3863d6f49bfd642)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:49.923669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:49.942082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:50.024626 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1282/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:49 2022] PUT /identity/v3/projects/663d9aea3dbc453cb62d35157bd61c6d/users/a85490e09bc04b7997c8c24a41af29a0/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:50.034890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.035181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.035478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.065721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] MFA Rules not processed for user `a85490e09bc04b7997c8c24a41af29a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:50.067044 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:50.069415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7eb39461f9545fda3863d6f49bfd642', 'request_id': 'req-f177a8a5-d712-4687-b62a-fa3c63e4ec75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:50.076415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7eb39461f9545fda3863d6f49bfd642', 'request_id': 'req-f177a8a5-d712-4687-b62a-fa3c63e4ec75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:50.146653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1283/2582] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:50.149691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7eb39461f9545fda3863d6f49bfd642', 'request_id': 'req-f177a8a5-d712-4687-b62a-fa3c63e4ec75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:50.151460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.165885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] The token cache is being invalidate because project b7eb39461f9545fda3863d6f49bfd642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:50.166177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:50.166878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f177a8a5-d712-4687-b62a-fa3c63e4ec75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:50.167302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:50.168596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1300/2583] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:49 2022] DELETE /identity/v3/projects/b7eb39461f9545fda3863d6f49bfd642 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:50.174524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a827-7032-4bcd-8495-5a106e202aea None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.174812 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a827-7032-4bcd-8495-5a106e202aea None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.175117 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a827-7032-4bcd-8495-5a106e202aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.193175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2025a827-7032-4bcd-8495-5a106e202aea None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:50.194460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2025a827-7032-4bcd-8495-5a106e202aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:50.225120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f2ae8-983f-40de-875e-50e5d1c5c8ff None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.230493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.231240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.231563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.232765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.233506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.236132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.267337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1301/2584] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:50.275206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.275497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.275781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.295440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:50.297041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:50.305255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1302/2585] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:50.309394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.326201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3df1e-adf4-42d7-9e64-d887178e51df None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.326201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.326201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.326201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.326700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.327174 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:50.327517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.329268 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.344202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1303/2586] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:50.348738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.360495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0eac6-c07e-469b-827f-7d368a9e2833 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.366307 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.367116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.367437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.367871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.368646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.370366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.438434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1284/2587] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:50.444319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.446492 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:50.517663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61040af5-0c14-4b95-ac9b-d1c849174149 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.522863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.523566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.523891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.524175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.524973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.526962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.552570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1304/2588] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:50.557358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.624910 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c84b3-ce43-4240-a792-c4f9915bb55c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.629922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.630700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.631006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.631281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.632076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.634195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.642579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:50.705063 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1285/2589] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:50.709281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.719872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ea7d9-36fb-424d-a9ec-0b2bb978af98 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.724590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.725305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.725622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.726145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.726699 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.728359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.739407 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1286/2590] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:50.743430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.755471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135cd48-47ce-4b47-8dba-dadc3ced72a1 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.760246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.766539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.766539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.766539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] PATH_INFO: `/v3/projects/20ed1147d07a45529bf24fca94e1eb65/users/ab7d206340cf4be9b32efd33016edacc/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.767897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1305/2591] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:50.770069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.778576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ed1147d07a45529bf24fca94e1eb65, user_id=ab7d206340cf4be9b32efd33016edacc, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.780846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1841-1f58-4b5c-a483-f17aa243a94d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.781300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.786092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.786772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.787071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.787363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.788152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.789849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.801210 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1306/2592] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:50.805502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.816921 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519eed-2a64-4b85-a7b4-69ad9cf82dc5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.822071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.823754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.823754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.823754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.824055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.825707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.837030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1307/2593] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:50.841231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.851610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273d14f-d50e-4043-8d76-81a3376deb44 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.856483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.858908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.858908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.858908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] PATH_INFO: `/v3/projects/c2410632f6dd465c9629f93dc7d10ba7/users/db8c89fc491b4503891f05200d7acf9b/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.859669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1287/2594] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:50 2022] PUT /identity/v3/projects/20ed1147d07a45529bf24fca94e1eb65/users/ab7d206340cf4be9b32efd33016edacc/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:50.863685 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.875959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2410632f6dd465c9629f93dc7d10ba7, user_id=db8c89fc491b4503891f05200d7acf9b, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.878501 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ae5a-0050-47fc-a3b8-592ad03520c8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.917529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:50.929775 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08934e-24c6-4c28-b812-6b9e2c6dcba5 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.934691 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.935445 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.935850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.936162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.936894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.938586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.949314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1288/2595] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:50.954032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:50.964053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffc32-28f4-4732-8c21-2ec618361e4a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:50.969311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:50.970259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.970540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.970871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] PATH_INFO: `/v3/projects/20ed1147d07a45529bf24fca94e1eb65/users/ab7d206340cf4be9b32efd33016edacc/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.972851 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ed1147d07a45529bf24fca94e1eb65, user_id=ab7d206340cf4be9b32efd33016edacc, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:50.975578 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba513864-2c2a-4a74-947e-e65a860f7b78 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:50.984735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1308/2596] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:50 2022] PUT /identity/v3/projects/c2410632f6dd465c9629f93dc7d10ba7/users/db8c89fc491b4503891f05200d7acf9b/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:50.987498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1289/2597] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:50 2022] PUT /identity/v3/projects/20ed1147d07a45529bf24fca94e1eb65/users/ab7d206340cf4be9b32efd33016edacc/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:50.996537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:50.996906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:50.997356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:50.999736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.000048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.000363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.027635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] MFA Rules not processed for user `db8c89fc491b4503891f05200d7acf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:51.031000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] MFA Rules not processed for user `ab7d206340cf4be9b32efd33016edacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:51.031126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.031354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.101209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1309/2598] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:51.105664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.111243 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1290/2599] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:51.124126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.125540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.176295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057c5d4-ea90-453b-91aa-1645709f437d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.181754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.182697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.182697 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.183134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.184120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.186249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.186366 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9581a-e3da-4739-a04c-3bf3e89ca35b None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.190214 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.190863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.191227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.191431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.203392 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.203728 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.214845 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1291/2600] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:51.309087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1310/2601] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:51 2022] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:22:51.313384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.324369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd34de-430a-4deb-a89c-bd423e4d5f9d service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.355013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.356836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.381646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:51.387296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.388108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.389083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.389463 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.390210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.392302 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.402294 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:51.421941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ca8a-3919-41ea-ba0c-efd9f98eb3c4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.425799 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.426547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.426836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.427133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.428996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.498390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1292/2602] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:22:51 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:22:51.498786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.499968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.503228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.510843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1311/2603] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:51.515413 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f272-bd32-483b-9e03-381a758fbf6f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.520930 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.521794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.522086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.522358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.523227 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.524901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.538306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1293/2604] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:22:51.542735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.554018 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52ed7-b45c-47d5-bbc0-5a2346d90d68 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.558900 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.559814 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.560602 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.560889 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] PATH_INFO: `/v3/projects/2fb58f7e0984430c8f1d217842beb7ab/users/26ea97406fc7465f8209f07088d63b85/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.577321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb58f7e0984430c8f1d217842beb7ab, user_id=26ea97406fc7465f8209f07088d63b85, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.580033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.658772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1312/2605] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:51 2022] PUT /identity/v3/projects/2fb58f7e0984430c8f1d217842beb7ab/users/26ea97406fc7465f8209f07088d63b85/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:51.662778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.673185 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536f0a1-e047-4de0-9706-23874a78e74d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.734033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.734630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.734918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.735195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.735928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.737544 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e353bb-5ed3-479f-ad5c-6b0be475ad3d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.751876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1294/2606] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:22:51.753355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.765793 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57471-b173-40ec-b337-87cce4962203 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.771519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.772134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.772428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.772721 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] PATH_INFO: `/v3/projects/2fb58f7e0984430c8f1d217842beb7ab/users/26ea97406fc7465f8209f07088d63b85/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.774739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb58f7e0984430c8f1d217842beb7ab, user_id=26ea97406fc7465f8209f07088d63b85, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:51.777465 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:51.788753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1313/2607] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:22:51 2022] PUT /identity/v3/projects/2fb58f7e0984430c8f1d217842beb7ab/users/26ea97406fc7465f8209f07088d63b85/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:51.799473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.799973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.800093 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.829239 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] MFA Rules not processed for user `26ea97406fc7465f8209f07088d63b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:51.830509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:51.902802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1295/2608] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:51.914479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:51.983354 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6bef8-53c1-4a65-92f2-7c5073fe9150 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:51.987446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:51.987908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:51.988214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:51.988473 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:51.999069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:52.000519 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:52.011109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1314/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:52.281639 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:52.292264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093be5-bccb-4f49-b5b1-e1c07dc4a850 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:52.296697 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:52.297368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:52.297836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:52.298088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:52.360322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:52.361814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a17c-ac50-400e-92de-1a66b9c66386 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:52.370817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1296/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:56.768261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:56.811685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:56.832581 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b51-9f94-4f93-95e0-97bfb0cda6fa service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:56.837836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:56.838861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:56.839147 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:56.839424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] PATH_INFO: `/v3/users/a85490e09bc04b7997c8c24a41af29a0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:56.840619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85490e09bc04b7997c8c24a41af29a0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:56.842601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:57.101391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85490e09bc04b7997c8c24a41af29a0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:57.102142 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85490e09bc04b7997c8c24a41af29a0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:57.112100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85490e09bc04b7997c8c24a41af29a0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:57.126027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85490e09bc04b7997c8c24a41af29a0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:57.198950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85490e09bc04b7997c8c24a41af29a0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:57.206832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1315/2611] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:56 2022] DELETE /identity/v3/users/a85490e09bc04b7997c8c24a41af29a0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:57.212173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:57.212704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:57.213230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:57.221337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:57.236656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:57.238081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:57.308488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1297/2612] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:57.318700 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:57.327625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:57.385710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a361d0b-a86f-4fd3-9391-eb9086dba730 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:57.389954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:57.390677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:57.390966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:57.391287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:57.403435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:57.404920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:57.415764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1316/2613] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:22:57.998938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:58.001741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:58.026045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43ddd1-fa24-4967-9bea-6b2805a6b754 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:58.033500 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:58.034880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:58.035338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:58.035989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] PATH_INFO: `/v3/projects/663d9aea3dbc453cb62d35157bd61c6d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:58.037506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663d9aea3dbc453cb62d35157bd61c6d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:58.039952 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:58.171688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663d9aea3dbc453cb62d35157bd61c6d', 'request_id': 'req-76b957b8-677c-44f3-a102-57d2a5a9a2d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.179303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663d9aea3dbc453cb62d35157bd61c6d', 'request_id': 'req-76b957b8-677c-44f3-a102-57d2a5a9a2d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.263666 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663d9aea3dbc453cb62d35157bd61c6d', 'request_id': 'req-76b957b8-677c-44f3-a102-57d2a5a9a2d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.277201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] The token cache is being invalidate because project 663d9aea3dbc453cb62d35157bd61c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:58.277506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.283428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.283428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1298/2614] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:57 2022] DELETE /identity/v3/projects/663d9aea3dbc453cb62d35157bd61c6d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:58.285191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:58.302912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f6e6-c964-47af-b0a8-32d6d4080e51 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:58.368670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:58.369546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:58.369864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:58.370145 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] PATH_INFO: `/v3/users/ab7d206340cf4be9b32efd33016edacc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:58.371393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7d206340cf4be9b32efd33016edacc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:58.373384 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:58.375788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:58.683459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7d206340cf4be9b32efd33016edacc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.684051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7d206340cf4be9b32efd33016edacc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.691691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7d206340cf4be9b32efd33016edacc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.703233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7d206340cf4be9b32efd33016edacc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.829194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7d206340cf4be9b32efd33016edacc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:58.836977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1317/2615] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:58 2022] DELETE /identity/v3/users/ab7d206340cf4be9b32efd33016edacc => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:59.217624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:59.219182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.232863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b957b8-677c-44f3-a102-57d2a5a9a2d2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:59.295860 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:59.296738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.297029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.297310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] PATH_INFO: `/v3/users/db8c89fc491b4503891f05200d7acf9b` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.299280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8c89fc491b4503891f05200d7acf9b)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:59.301240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:59.353879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:59.353879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.361847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350192ba-9bb0-4d86-96d2-4a871dc4fc32 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:59.367418 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:59.368559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.369013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.369394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] PATH_INFO: `/v3/projects/20ed1147d07a45529bf24fca94e1eb65` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.371106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ed1147d07a45529bf24fca94e1eb65)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:59.372770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:59.472452 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:59.565035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ed1147d07a45529bf24fca94e1eb65', 'request_id': 'req-214be6d3-6433-4b94-9386-69c48425b332'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.565264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8c89fc491b4503891f05200d7acf9b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.571920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ed1147d07a45529bf24fca94e1eb65', 'request_id': 'req-214be6d3-6433-4b94-9386-69c48425b332'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.572473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8c89fc491b4503891f05200d7acf9b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.573252 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8c89fc491b4503891f05200d7acf9b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.585753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8c89fc491b4503891f05200d7acf9b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.669371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ed1147d07a45529bf24fca94e1eb65', 'request_id': 'req-214be6d3-6433-4b94-9386-69c48425b332'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.682166 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] The token cache is being invalidate because project 20ed1147d07a45529bf24fca94e1eb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:22:59.682451 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.683104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-214be6d3-6433-4b94-9386-69c48425b332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.684694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1318/2616] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:22:59 2022] DELETE /identity/v3/projects/20ed1147d07a45529bf24fca94e1eb65 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:22:59.689420 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8700-062e-49d3-9a68-2cf04a0ae776 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.689729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8700-062e-49d3-9a68-2cf04a0ae776 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.690004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8700-062e-49d3-9a68-2cf04a0ae776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.708469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f4ff8700-062e-49d3-9a68-2cf04a0ae776 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:59.709714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f4ff8700-062e-49d3-9a68-2cf04a0ae776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.726409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b365c0a7-ccef-4086-8d94-8e86ae470f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8c89fc491b4503891f05200d7acf9b'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:22:59.733846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1299/2617] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:22:59 2022] DELETE /identity/v3/users/db8c89fc491b4503891f05200d7acf9b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:22:59.739216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.741328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.741328 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.757780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:59.759006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.775446 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1319/2618] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:59.783941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.784233 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.784568 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.792817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:59.804530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:59.811231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.822741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1300/2619] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:59.833255 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:59.835532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:59.878031 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1320/2620] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:22:59.882237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:59.895679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdf363-c9ea-4014-9ef1-abe422c02570 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:59.898707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2b79-9d8c-42e5-ad9c-2f032763d1b4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:59.908631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:59.908825 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:59.908961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.908961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.909137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.909137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.909397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.909674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.909780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:22:59.909964 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:59.911583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:59.921196 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:59.922028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:22:59.930348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1321/2621] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:22:59.932341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:22:59.934618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1301/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:22:59.943920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d163-740c-4afa-a546-456cf949fc9c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:22:59.950424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:22:59.951095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:59.951681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:59.951681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:59.952343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:22:59.955554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.081030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1322/2623] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:22:59 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:00.082384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.092501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28666d-863a-4c2a-8e55-647bf71eb616 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.140526 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:00.154001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.154680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.154970 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.155369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.156056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.158150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.235516 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1302/2624] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:00 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:00.239739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.250729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b6618-1f8a-4d21-b3bf-acaf0040ae1e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.256241 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.256928 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.257217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.257497 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.258251 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.259865 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.272463 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1323/2625] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:00.278271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.289458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186019c1-ecb5-43ff-9cce-a60a91da5236 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.294340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.295028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.295599 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.296007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.296925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.299220 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454905-dd22-4878-a262-a82acf0c659c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.310745 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1303/2626] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:00.317363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.337333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4e467-018a-4f8b-8e18-8eab42bd471b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.344027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.345116 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.345506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.345962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] PATH_INFO: `/v3/projects/b154c2f4129443d1acd26ef52d821576/users/7788756c40204d1587ef49de4b26e79e/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.364359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b154c2f4129443d1acd26ef52d821576, user_id=7788756c40204d1587ef49de4b26e79e, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.367632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.474089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1324/2627] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:00 2022] PUT /identity/v3/projects/b154c2f4129443d1acd26ef52d821576/users/7788756c40204d1587ef49de4b26e79e/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:00.484458 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.484781 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.485069 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.519350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] MFA Rules not processed for user `7788756c40204d1587ef49de4b26e79e`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:00.520752 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:00.588575 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1304/2628] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:00.593152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.602657 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.604186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:00.703004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2224-7c06-45ef-9458-0d6958e929b9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.711630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b918465-5829-4523-b250-d0546ae1ffe5 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.714981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.716121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.716674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.717287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.717422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.718425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.719305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.719664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.720080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] PATH_INFO: `/v3/projects/c2410632f6dd465c9629f93dc7d10ba7` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.721629 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.722000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2410632f6dd465c9629f93dc7d10ba7)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.735377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.814807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1325/2629] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:00 2022] POST /identity/v3/projects => generated 401 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:00.818851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.843903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:00.862488 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2410632f6dd465c9629f93dc7d10ba7', 'request_id': 'req-91824787-b021-456e-aa9c-0a5e306293a6'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:00.875943 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2410632f6dd465c9629f93dc7d10ba7', 'request_id': 'req-91824787-b021-456e-aa9c-0a5e306293a6'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:00.880986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:00.889907 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94cb2-d8a6-4033-98cf-eedcd212e0e7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.938925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2410632f6dd465c9629f93dc7d10ba7', 'request_id': 'req-91824787-b021-456e-aa9c-0a5e306293a6'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:00.957850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] The token cache is being invalidate because project c2410632f6dd465c9629f93dc7d10ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:00.958204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:00.960248 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:00.961055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.963921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1305/2630] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:00 2022] DELETE /identity/v3/projects/c2410632f6dd465c9629f93dc7d10ba7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:00.964028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.964028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.964028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.964028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.965339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:00.965589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:00.966980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:00.984318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824787-b021-456e-aa9c-0a5e306293a6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:00.992438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:00.994719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:00.994719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:00.994719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] PATH_INFO: `/v3/users/26ea97406fc7465f8209f07088d63b85` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:00.996019 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ea97406fc7465f8209f07088d63b85)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:00.998256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.099534 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1326/2631] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:00 2022] POST /identity/v3/users => generated 307 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:01.103598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.106059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:01.120867 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f658b1-6869-41b7-88d4-b2914a07fa31 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:01.130129 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:01.131069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.131435 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.131720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.132483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:01.134203 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.151576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1327/2632] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:01.152731 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.165870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a763a5-e7a5-42c5-b7dd-2409de8c658b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:01.172555 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:01.174047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.174333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.175035 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] PATH_INFO: `/v3/projects/57523057b37f4638b440b810dd063975/users/15b6f6ab12114ef79208888c537299d2/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.200204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ea97406fc7465f8209f07088d63b85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:01.206422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57523057b37f4638b440b810dd063975, user_id=15b6f6ab12114ef79208888c537299d2, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:01.209302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.210687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ea97406fc7465f8209f07088d63b85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:01.211576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ea97406fc7465f8209f07088d63b85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:01.228259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ea97406fc7465f8209f07088d63b85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:01.321403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1328/2633] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:01 2022] PUT /identity/v3/projects/57523057b37f4638b440b810dd063975/users/15b6f6ab12114ef79208888c537299d2/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:01.336790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.349645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ea97406fc7465f8209f07088d63b85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:01.357974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1306/2634] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:00 2022] DELETE /identity/v3/users/26ea97406fc7465f8209f07088d63b85 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:01.401914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a5db-80fe-49a9-8473-ad10d22c3e1c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:01.487768 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:01.488758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.489048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.489326 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.490162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:01.491885 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede815-b99a-4b98-bc5c-f6566ca8236a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.504428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1329/2635] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:01.508776 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.510320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:01.527191 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf7128-5c25-40e9-a22b-5aafa134b910 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:01.532001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:01.533179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.533453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.533864 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] PATH_INFO: `/v3/projects/57523057b37f4638b440b810dd063975/users/15b6f6ab12114ef79208888c537299d2/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.535911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57523057b37f4638b440b810dd063975, user_id=15b6f6ab12114ef79208888c537299d2, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:01.538605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.554731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1307/2636] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:01 2022] PUT /identity/v3/projects/57523057b37f4638b440b810dd063975/users/15b6f6ab12114ef79208888c537299d2/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:01.566936 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.568133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.568133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.600424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] MFA Rules not processed for user `15b6f6ab12114ef79208888c537299d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:01.602042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:01.621146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:01.686390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1330/2637] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:01.698467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.700566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:01.773187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf6edc-11b4-4b1b-a952-0487d2a11385 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:01.777768 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:01.778601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:01.778897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:01.779183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:01.790384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:01.791944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:01.809311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1308/2638] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:01.899091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:01.902999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:01.997550 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615cb6-01f9-4a7d-b2b4-b5d7a13586b1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.004386 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.005089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.005376 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.005690 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] PATH_INFO: `/v3/projects/2fb58f7e0984430c8f1d217842beb7ab` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.006923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb58f7e0984430c8f1d217842beb7ab)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.008863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.128316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.138509 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad05b5-ecf8-409f-acbc-995499d2bedf service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.149731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.149731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.149731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.149731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.150310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:02.163206 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb58f7e0984430c8f1d217842beb7ab', 'request_id': 'req-1af30460-dcaa-4eb2-b774-d8d7a769db60'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:02.171397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb58f7e0984430c8f1d217842beb7ab', 'request_id': 'req-1af30460-dcaa-4eb2-b774-d8d7a769db60'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:02.216635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.218267 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10772017-928e-4c9a-981c-eb94f2abe31f service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.229791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:02.236336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1309/2639] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:02.253904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb58f7e0984430c8f1d217842beb7ab', 'request_id': 'req-1af30460-dcaa-4eb2-b774-d8d7a769db60'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:02.263253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] The token cache is being invalidate because project 2fb58f7e0984430c8f1d217842beb7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:02.263543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:02.264336 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1af30460-dcaa-4eb2-b774-d8d7a769db60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:02.266103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1331/2640] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:01 2022] DELETE /identity/v3/projects/2fb58f7e0984430c8f1d217842beb7ab => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:02.271258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.271674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.271922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.290308 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:02.291533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:02.359303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1310/2641] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:02.368269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.374025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.374025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.392440 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:02.393957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:02.408153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1332/2642] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:02.408884 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.419037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c87e-a5ce-49e4-a334-258fbfe99083 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.425282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.427607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.427918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.428270 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.428965 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:02.429464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.431187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.444257 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1311/2643] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:23:02.448643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.459191 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6af742-f648-4407-9058-18385fa7c064 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.466710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.468573 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.468743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.468989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.469736 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.472413 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.479216 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:02.585830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1333/2644] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:02 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:02.589840 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.600807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64335-ed3c-49f8-aaa2-67c9fe40deab admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.659876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.660513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.660803 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.661087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.661817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.663738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.765306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1312/2645] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:02 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:02.770395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.781755 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4a50-41e2-45de-a025-b668b9f96759 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.787427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.788202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.788495 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.788771 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.789492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.791182 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.802782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1334/2646] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:02.807882 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.818517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861441-2e14-4a51-a01e-be474ce16a50 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.823115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.823778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.824062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.824338 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.825061 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.826687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278afd8-a751-4420-81d0-2e9309b56f54 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:02.843230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1313/2647] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:02.848424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:02.858756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789e7b-ccd5-4852-8af5-8b058708f096 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:02.864339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:02.865253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:02.865531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:02.868530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] PATH_INFO: `/v3/projects/02b9aaa271f24d60bd0ac69568076c92/users/efc9c2c53f214a8ca91f79af8cc6efc0/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:02.880959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b9aaa271f24d60bd0ac69568076c92, user_id=efc9c2c53f214a8ca91f79af8cc6efc0, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:02.883652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:03.041518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1335/2648] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:02 2022] PUT /identity/v3/projects/02b9aaa271f24d60bd0ac69568076c92/users/efc9c2c53f214a8ca91f79af8cc6efc0/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:03.065811 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:03.066113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:03.066397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:03.100475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] MFA Rules not processed for user `efc9c2c53f214a8ca91f79af8cc6efc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:03.100475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:03.152100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:03.178538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1314/2649] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:03.191402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:03.193138 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:03.255198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef2497-9686-4548-af41-68686e0b305c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:03.259133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:03.259781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:03.260064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:03.260341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:03.270060 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:03.271509 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da66d-61a8-478b-af81-019d7a04d49b service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:03.280560 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1336/2650] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:03.300287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:03.374947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9b99a-82b8-4212-b548-1e18431fcc81 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:03.380621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:03.381511 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:03.381829 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:03.382157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] PATH_INFO: `/v3/users/efc9c2c53f214a8ca91f79af8cc6efc0` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:03.383329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc9c2c53f214a8ca91f79af8cc6efc0)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:03.385237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:03.801868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc9c2c53f214a8ca91f79af8cc6efc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:03.809189 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc9c2c53f214a8ca91f79af8cc6efc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:03.809826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc9c2c53f214a8ca91f79af8cc6efc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:03.822148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc9c2c53f214a8ca91f79af8cc6efc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:03.949791 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc9c2c53f214a8ca91f79af8cc6efc0'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:03.959155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1315/2651] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:03 2022] DELETE /identity/v3/users/efc9c2c53f214a8ca91f79af8cc6efc0 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:03.963425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:03.963920 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:03.964088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:03.983904 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:03.985195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:04.049353 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1337/2652] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:04.060082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:04.061692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:04.129342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4a8fe-e7ab-43a7-8263-1c764fecc0a2 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:04.133724 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:04.134432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:04.134721 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:04.135003 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:04.146188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:04.147678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef35fc8-00c8-4826-8004-b04d0fa189b6 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:04.158828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1316/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:04.602262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:04.602591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:04.615922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff07c2-621c-458b-942a-f6025cfd75f9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:04.620849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:04.621752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:04.622036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:04.622343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] PATH_INFO: `/v3/projects/02b9aaa271f24d60bd0ac69568076c92` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:04.623531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b9aaa271f24d60bd0ac69568076c92)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:04.625541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:04.643533 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:04.778849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b9aaa271f24d60bd0ac69568076c92', 'request_id': 'req-93813261-eb70-418f-8155-4aaded256d75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:04.784924 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b9aaa271f24d60bd0ac69568076c92', 'request_id': 'req-93813261-eb70-418f-8155-4aaded256d75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:04.904398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b9aaa271f24d60bd0ac69568076c92', 'request_id': 'req-93813261-eb70-418f-8155-4aaded256d75'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:04.917605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] The token cache is being invalidate because project 02b9aaa271f24d60bd0ac69568076c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:04.917908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:04.918557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-93813261-eb70-418f-8155-4aaded256d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:04.920239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1338/2654] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:04 2022] DELETE /identity/v3/projects/02b9aaa271f24d60bd0ac69568076c92 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:04.926390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:04.926918 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:04.927040 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:04.934336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:04.945841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:04.947148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:05.012738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1317/2655] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:05.021137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.021623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.021747 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.041103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:05.042406 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:05.051489 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1339/2656] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:05.056048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.065858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e2ac-5b92-45c2-92b6-11d268ba7c8e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.070438 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.071092 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.071377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.071655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.072378 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:05.072688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.074356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.087046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1318/2657] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:23:05.091416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.101791 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018864-8827-4d67-a6da-9b1a7aa95bd1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.106753 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.107404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.107685 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.107957 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.108643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.110596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.223756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1340/2658] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:05.227989 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.238410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e89568-d0dd-45b5-af0c-283da8a2a3d8 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.305563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.306278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.306565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.306846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.307663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.309693 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.418734 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1319/2659] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:05.423063 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.433691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619362-ffb8-4ca0-8b78-da0aa0f996f9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.438397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.439076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.439882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.440358 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.441231 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.442915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.454657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1341/2660] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:05.460937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.471785 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1ced-700a-4f6e-b2ca-7248c677c443 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.477490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.478222 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.478512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.478793 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.479603 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.481216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313ff9c-9beb-43a0-ad6d-cdf442ecbf88 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.492286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1320/2661] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:05.496810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.507490 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d93d-890e-4ae2-af55-581f12e0e321 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.512287 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.513196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.513496 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.513847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] PATH_INFO: `/v3/projects/c2d4bc8f8dba4b1f8717e04be0befdb0/users/1b7d08e206d746e0ba3b4bba6218b80a/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.530816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d4bc8f8dba4b1f8717e04be0befdb0, user_id=1b7d08e206d746e0ba3b4bba6218b80a, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.533652 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.669985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1342/2662] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:05 2022] PUT /identity/v3/projects/c2d4bc8f8dba4b1f8717e04be0befdb0/users/1b7d08e206d746e0ba3b4bba6218b80a/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:05.680917 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.681213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.681496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.709346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] MFA Rules not processed for user `1b7d08e206d746e0ba3b4bba6218b80a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:05.710900 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:05.778651 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:05.786131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1321/2663] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:05.787257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.858561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef0c4-4904-493f-80cf-731b46044da0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:05.868868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:05.868868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:05.868868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:05.868868 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:05.869314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:05.869314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:05.974288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1343/2664] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:05.978330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:05.990281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03383a03-4b26-407f-b71e-9b675ccfe908 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.047190 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.047872 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.048155 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.048439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.049674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.051590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.149914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1322/2665] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:05 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:06.153800 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.164930 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c34-2e51-4e37-8e78-d63770bbb366 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.170464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.170464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.170698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.170846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.171590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.173188 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.185013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1344/2666] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:06.189447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.200443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed259c-71c0-4382-98b6-f74eab8af99e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.205272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.206167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.206455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.206731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] PATH_INFO: `/v3/projects/af4fa7f7485d4ce59928ece50ace9059/users/f59d9950367b4280b82abbd345922881/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.225730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4fa7f7485d4ce59928ece50ace9059, user_id=f59d9950367b4280b82abbd345922881, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.228419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.305045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1323/2667] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:06 2022] PUT /identity/v3/projects/af4fa7f7485d4ce59928ece50ace9059/users/f59d9950367b4280b82abbd345922881/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:06.309260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.320200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93816-c1cc-49c7-8edd-396aed86266e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.329605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:06.380784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.381457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.381969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.382114 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.382831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.384691 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3ac5d-ad1c-4cc1-ab39-906422b09ae4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.395723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1345/2668] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:06.400358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.411306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202543-65ba-40da-812f-5bb333b1441c admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.416212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.417200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.417384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.417687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] PATH_INFO: `/v3/projects/af4fa7f7485d4ce59928ece50ace9059/users/f59d9950367b4280b82abbd345922881/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.419754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4fa7f7485d4ce59928ece50ace9059, user_id=f59d9950367b4280b82abbd345922881, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.422520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.434563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1324/2669] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:06 2022] PUT /identity/v3/projects/af4fa7f7485d4ce59928ece50ace9059/users/f59d9950367b4280b82abbd345922881/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:06.503308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.503600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.503882 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.531370 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] MFA Rules not processed for user `f59d9950367b4280b82abbd345922881`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:06.532623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:06.602754 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1346/2670] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:06.614165 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.616088 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:06.685975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170332-d0ae-46c7-b947-d6bd4dcf8f36 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.689787 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.690844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.691175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.691528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.722493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:06.723898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:06.756679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.758174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.769259 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1325/2671] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:06.784835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b5d2b-678f-48af-bb89-d6098351af52 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:06.788901 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:06.789564 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:06.789879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:06.790157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:06.791970 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:06.846518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:06.861877 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:06.863331 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992b164-b914-4c2b-bca3-3eade64dd3f9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:06.873549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1347/2672] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:07.691095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:07.692540 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:07.708559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f69bc-7562-43a3-8ded-ef8542aec165 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:07.713891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:07.714773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:07.715052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:07.715324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] PATH_INFO: `/v3/users/7788756c40204d1587ef49de4b26e79e` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:07.716524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7788756c40204d1587ef49de4b26e79e)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:07.718611 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:07.722820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:07.929674 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7788756c40204d1587ef49de4b26e79e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:07.939730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7788756c40204d1587ef49de4b26e79e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:07.940619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7788756c40204d1587ef49de4b26e79e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:07.957001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7788756c40204d1587ef49de4b26e79e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:08.036410 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7788756c40204d1587ef49de4b26e79e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:08.044104 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1326/2673] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:07 2022] DELETE /identity/v3/users/7788756c40204d1587ef49de4b26e79e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:08.048859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:08.055423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:08.055423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:08.067394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:08.068620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:08.135306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1348/2674] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:08.146120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:08.147683 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:08.221824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79918479-fcaa-4e23-872b-126c0aa2a8e3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:08.221824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:08.221824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:08.221824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:08.222344 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:08.227145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:08.228635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:08.239435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1327/2675] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:08.744674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:08.746443 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:08.762510 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760547df-24cc-4673-b8e4-98cc8455325e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:08.769516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:08.770444 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:08.770728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:08.770998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] PATH_INFO: `/v3/projects/b154c2f4129443d1acd26ef52d821576` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:08.773609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b154c2f4129443d1acd26ef52d821576)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:08.774766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:08.911126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b154c2f4129443d1acd26ef52d821576', 'request_id': 'req-333f38ce-f86d-48f9-9347-3f87f80b3463'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:08.917706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b154c2f4129443d1acd26ef52d821576', 'request_id': 'req-333f38ce-f86d-48f9-9347-3f87f80b3463'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:08.995692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b154c2f4129443d1acd26ef52d821576', 'request_id': 'req-333f38ce-f86d-48f9-9347-3f87f80b3463'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.012707 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] The token cache is being invalidate because project b154c2f4129443d1acd26ef52d821576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:09.012941 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.013694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.033095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:09.033892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1349/2676] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:08 2022] DELETE /identity/v3/projects/b154c2f4129443d1acd26ef52d821576 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:09.045448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ec48e-e8a8-4e72-8bbe-d7f2db644b44 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:09.120450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:09.121380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:09.121676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:09.121907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] PATH_INFO: `/v3/users/15b6f6ab12114ef79208888c537299d2` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:09.123192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b6f6ab12114ef79208888c537299d2)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:09.125178 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:09.153941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:09.363466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b6f6ab12114ef79208888c537299d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.370968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b6f6ab12114ef79208888c537299d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.371707 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b6f6ab12114ef79208888c537299d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.385048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b6f6ab12114ef79208888c537299d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.547663 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b6f6ab12114ef79208888c537299d2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:09.556622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1328/2677] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:09 2022] DELETE /identity/v3/users/15b6f6ab12114ef79208888c537299d2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:09.926121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:09.928020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:09.942911 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f38ce-f86d-48f9-9347-3f87f80b3463 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.026844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.028399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.028772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.030531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] PATH_INFO: `/v3/users/1b7d08e206d746e0ba3b4bba6218b80a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.032748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7d08e206d746e0ba3b4bba6218b80a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.037267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.053124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:10.128122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:10.129610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.143195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e01af-d4bb-4a90-a802-877131c592e4 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.148008 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.148893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.149175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.149451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] PATH_INFO: `/v3/projects/57523057b37f4638b440b810dd063975` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.150686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=57523057b37f4638b440b810dd063975)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.156233 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.288414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7d08e206d746e0ba3b4bba6218b80a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.293111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7d08e206d746e0ba3b4bba6218b80a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.308106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7d08e206d746e0ba3b4bba6218b80a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.311122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57523057b37f4638b440b810dd063975', 'request_id': 'req-f58f9d51-5774-41d6-a20a-1763deb889ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.319955 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57523057b37f4638b440b810dd063975', 'request_id': 'req-f58f9d51-5774-41d6-a20a-1763deb889ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.335572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7d08e206d746e0ba3b4bba6218b80a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.433348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57523057b37f4638b440b810dd063975', 'request_id': 'req-f58f9d51-5774-41d6-a20a-1763deb889ed'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.446940 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] The token cache is being invalidate because project 57523057b37f4638b440b810dd063975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:10.447350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.448051 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-f58f9d51-5774-41d6-a20a-1763deb889ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.450007 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1329/2678] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:10 2022] DELETE /identity/v3/projects/57523057b37f4638b440b810dd063975 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:10.455892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1751ca-859f-4087-ac5c-72ba54e52925 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.459767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1751ca-859f-4087-ac5c-72ba54e52925 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.459767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1751ca-859f-4087-ac5c-72ba54e52925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.486230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5c1751ca-859f-4087-ac5c-72ba54e52925 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:10.489000 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5c1751ca-859f-4087-ac5c-72ba54e52925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.530359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f2683b24-86cd-4214-8745-5cbe7e34c532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7d08e206d746e0ba3b4bba6218b80a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:10.538219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1350/2679] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:09 2022] DELETE /identity/v3/users/1b7d08e206d746e0ba3b4bba6218b80a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:10.544171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.545973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.546430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.567783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:10.569469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.581938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1330/2680] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:10.589777 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.590097 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.590384 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.611881 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:10.613212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.635258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:10.649541 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1351/2681] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:10.657407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:10.661633 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.699379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1331/2682] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:10.703163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:10.716605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb2390-c5ad-450f-a8ca-3f7c8e5f77b3 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.722315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.723123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.723513 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.724119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.725182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:10.725601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.727347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.745964 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1332/2683] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:23:10.749249 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:10.762249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4974-b99f-45fc-bbd4-3c64ce27a646 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.766616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.767277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.768270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.768898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.773563 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3ee8-4bd6-4e26-95ce-63a573933708 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.780764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.782574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.785830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.786643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.787206 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.787631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.789229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.792562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.793479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1352/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:11.030802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1333/2685] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:10 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:11.034198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.044359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bca7f7-6f05-444a-bdcf-f9e23d2d98cc service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.064099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.066528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.095068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:11.160583 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.161304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.161603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.161893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.162594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.166113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.168283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4bd2f-8237-4486-ae57-1eb84bba1596 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.176551 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.177857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.177857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.178172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] PATH_INFO: `/v3/users/cb30fcf6e0494463a3172bb37e38ab85` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.179426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb30fcf6e0494463a3172bb37e38ab85)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.181530 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.287419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1353/2686] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:11 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:11.291133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.302093 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805720-06b5-4e7e-8a9a-9b26985c000d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.306773 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.313375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.313375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.313375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.313375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.313375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.321285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1354/2687] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:11.325439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.335483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dab37-3890-4127-80fa-88736b33c8f9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.340194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.340835 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.341120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.341398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.342170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.343739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.355290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1355/2688] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:11.359267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.370218 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4edd8-61ba-410f-9df7-c2c11f695253 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.374844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.375717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.376000 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.376297 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] PATH_INFO: `/v3/projects/5daea77cf42846cea24a7c66ce80a625/users/672513ad1b40416eb84e61431154a260/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.391866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5daea77cf42846cea24a7c66ce80a625, user_id=672513ad1b40416eb84e61431154a260, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.395082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.493531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1356/2689] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:11 2022] PUT /identity/v3/projects/5daea77cf42846cea24a7c66ce80a625/users/672513ad1b40416eb84e61431154a260/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:11.501917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.501917 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.508682 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb30fcf6e0494463a3172bb37e38ab85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.517180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb30fcf6e0494463a3172bb37e38ab85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.517796 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb30fcf6e0494463a3172bb37e38ab85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.529854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb30fcf6e0494463a3172bb37e38ab85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.565189 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca4e6-8a70-4f5d-ab3e-899ee873dedb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.570162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.571208 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.571492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.571766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] PATH_INFO: `/v3/projects/c2d4bc8f8dba4b1f8717e04be0befdb0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.572953 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d4bc8f8dba4b1f8717e04be0befdb0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.574876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.617601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1858460e-0dac-4f33-9e7f-422a62dffcfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb30fcf6e0494463a3172bb37e38ab85'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.624114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1334/2690] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:11 2022] DELETE /identity/v3/users/cb30fcf6e0494463a3172bb37e38ab85 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:11.625449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.625780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.626083 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.653496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] MFA Rules not processed for user `672513ad1b40416eb84e61431154a260`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:11.654742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.693262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:11.713914 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d4bc8f8dba4b1f8717e04be0befdb0', 'request_id': 'req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.719563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d4bc8f8dba4b1f8717e04be0befdb0', 'request_id': 'req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.725478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1335/2691] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:11.729932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.731454 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.801362 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caae61c-9ca8-43a4-8f35-4e8a06927586 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.812068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d4bc8f8dba4b1f8717e04be0befdb0', 'request_id': 'req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.824512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] The token cache is being invalidate because project c2d4bc8f8dba4b1f8717e04be0befdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:11.824739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.825382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:11.826979 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1357/2692] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:11 2022] DELETE /identity/v3/projects/c2d4bc8f8dba4b1f8717e04be0befdb0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:11.831663 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.832977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.864009 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.864676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.864987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.865264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.865995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.867939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.900820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b51d53-59f1-4b4d-b8a3-9d6e9bef8836 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:11.911940 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:11.912843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:11.913157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:11.913434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] PATH_INFO: `/v3/users/f59d9950367b4280b82abbd345922881` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:11.914769 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59d9950367b4280b82abbd345922881)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:11.916738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:11.965658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1336/2693] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:11 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:11.965658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:11.967057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:11.978402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:12.032204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c03d34-e33b-4729-8de0-f821c6b8ca2b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.038047 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.038914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.039238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.039602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] PATH_INFO: `/v3/projects/c1e6e20ff4b44ca0abab9e8065d53b1f` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.040814 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e6e20ff4b44ca0abab9e8065d53b1f)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.042794 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.148434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59d9950367b4280b82abbd345922881'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.149306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59d9950367b4280b82abbd345922881'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.156645 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59d9950367b4280b82abbd345922881'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.165616 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e6e20ff4b44ca0abab9e8065d53b1f', 'request_id': 'req-b353ed90-b897-4a65-8eef-ee00b9f4ed08'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.168992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59d9950367b4280b82abbd345922881'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.172053 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e6e20ff4b44ca0abab9e8065d53b1f', 'request_id': 'req-b353ed90-b897-4a65-8eef-ee00b9f4ed08'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.255537 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59d9950367b4280b82abbd345922881'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.261994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1358/2694] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:11 2022] DELETE /identity/v3/users/f59d9950367b4280b82abbd345922881 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:12.262763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.264120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.326282 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e6e20ff4b44ca0abab9e8065d53b1f', 'request_id': 'req-b353ed90-b897-4a65-8eef-ee00b9f4ed08'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.337572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f42bd-02da-4345-9005-7e0668c9c4a6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.340182 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] The token cache is being invalidate because project c1e6e20ff4b44ca0abab9e8065d53b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:12.340542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.341238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-b353ed90-b897-4a65-8eef-ee00b9f4ed08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.342878 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.343090 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1337/2695] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:11 2022] DELETE /identity/v3/projects/c1e6e20ff4b44ca0abab9e8065d53b1f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:12.347062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.347472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.347845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.348020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50624-60c8-4e9c-ad52-211b62fbcbf6 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.348738 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.349418 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:12.349967 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50624-60c8-4e9c-ad52-211b62fbcbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.350377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50624-60c8-4e9c-ad52-211b62fbcbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.350808 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.369560 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-09e50624-60c8-4e9c-ad52-211b62fbcbf6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:12.370897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-09e50624-60c8-4e9c-ad52-211b62fbcbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.380025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1338/2696] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:12.387992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.388254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.388543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.407782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:12.409482 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.418377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1339/2697] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:12.422779 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.430937 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1359/2698] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:12.432835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117459ea-e967-4853-a1e8-1984c7b32a33 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.435257 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.437013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.441258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.442046 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.442858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.442858 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.443450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:12.443769 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.445827 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.450590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf2235-77c6-4ee6-a51c-61921f99e09b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.456978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.457702 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.458048 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.458310 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.459046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.460952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.462714 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1340/2699] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:23:12.467696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.484244 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59ce2-8102-4fe8-bafa-1f16345e5e8a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.484724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1360/2700] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:12.485330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.489263 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.489997 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.490434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.490806 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.491521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.493557 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.497195 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b2df-37d2-4921-a772-c58aa9a22edc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.504637 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.505607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.505892 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.506184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] PATH_INFO: `/v3/projects/dbe87a5ce3694031a82e7a053e62b66d/users/c41e699d2c7242f996868fe0a6a091b2/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.524923 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe87a5ce3694031a82e7a053e62b66d, user_id=c41e699d2c7242f996868fe0a6a091b2, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.528870 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.579838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1341/2701] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:12.585457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.617133 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1361/2702] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:12 2022] PUT /identity/v3/projects/dbe87a5ce3694031a82e7a053e62b66d/users/c41e699d2c7242f996868fe0a6a091b2/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:12.621097 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.649352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8c5e9-7e53-42e2-97ad-bc622c4bb297 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.682296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:12.684739 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ec75-76d4-4121-bdb3-3bff33873d77 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.690851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.691529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.691820 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.692098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.692818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.694525 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.704589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1362/2703] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:12.708163 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.708767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.708893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.709234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.709706 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.710688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.712632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9acf93-aab8-4b37-a86d-4037b570dcca admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.719347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ebd4-34e3-4324-bd09-8ad2358f9c3d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.725787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.726464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.726742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.727011 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] PATH_INFO: `/v3/projects/dbe87a5ce3694031a82e7a053e62b66d/users/c41e699d2c7242f996868fe0a6a091b2/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.729038 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe87a5ce3694031a82e7a053e62b66d, user_id=c41e699d2c7242f996868fe0a6a091b2, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.731689 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.752966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1363/2704] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:12 2022] PUT /identity/v3/projects/dbe87a5ce3694031a82e7a053e62b66d/users/c41e699d2c7242f996868fe0a6a091b2/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:12.752966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.752966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.759431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:12.818171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d187-e383-450d-b428-bceb4c569078 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.822929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:12.823783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.824071 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.824352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] PATH_INFO: `/v3/projects/af4fa7f7485d4ce59928ece50ace9059` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.825552 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4fa7f7485d4ce59928ece50ace9059)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:12.827487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:12.835590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1342/2705] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:12.840238 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:12.840531 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:12.840951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:12.868722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] MFA Rules not processed for user `c41e699d2c7242f996868fe0a6a091b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:12.870035 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:12.942068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1343/2706] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:12.942914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:12.951389 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4fa7f7485d4ce59928ece50ace9059', 'request_id': 'req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:12.953411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a26c5-2554-4949-9a1c-69c5a570e7fd None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:12.958144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4fa7f7485d4ce59928ece50ace9059', 'request_id': 'req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:13.012124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.012833 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.013120 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.013399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.014176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.015780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.026251 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1344/2707] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:13.027280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.029001 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.063352 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4fa7f7485d4ce59928ece50ace9059', 'request_id': 'req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:13.075774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:13.077255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] The token cache is being invalidate because project af4fa7f7485d4ce59928ece50ace9059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:13.077622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:13.078295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:13.092101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1364/2708] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:12 2022] DELETE /identity/v3/projects/af4fa7f7485d4ce59928ece50ace9059 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:13.092101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.092101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.092506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316b6cf-daa7-4b5f-9518-19166e8f2015 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.095173 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.096374 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.096658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.096916 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.099018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.106676 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72419-97a6-4e21-9da7-2ec3f4e6ad99 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.112579 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.113275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.113559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.113866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.114613 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.116280 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.130948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1365/2709] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:13.131250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:13.132810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.143615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693daa5e-9248-4277-b693-7568f764ac15 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.149032 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.149995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.150393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.150831 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] PATH_INFO: `/v3/projects/b9aba7a8544a4635bc1ddf1d5da5f416/users/1e8c1a519e28470b8b25013563463d9d/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.170120 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aba7a8544a4635bc1ddf1d5da5f416, user_id=1e8c1a519e28470b8b25013563463d9d, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.172787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.183780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.185280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488e2b6-d085-4e63-8955-4efb0ac9eb56 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.197027 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1345/2710] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:13.281393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1366/2711] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:13 2022] PUT /identity/v3/projects/b9aba7a8544a4635bc1ddf1d5da5f416/users/1e8c1a519e28470b8b25013563463d9d/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:13.292585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.292880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.293167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.319259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.321150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.330695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] MFA Rules not processed for user `1e8c1a519e28470b8b25013563463d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:13.331911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.383660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ac35-5a83-4335-9a9d-686aac8ee9a4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.387532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.388275 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.388706 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.388985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.390884 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:13.404121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1346/2712] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:13.408996 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.456642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.456642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.465447 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1367/2713] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:13.475936 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12534-0fa8-458f-a14c-693c770c9854 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.481498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.482211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.482555 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.482842 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.483536 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.485453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.501664 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:13.596556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1347/2714] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:13 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:13.597891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.608851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7088-1aa5-4548-bde5-06bb13654874 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.665341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.666041 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.666325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.666603 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.667306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.669209 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.776954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:13.782487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1368/2715] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:13 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:13.787187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.797720 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0d864-28eb-46c4-951c-738586efb332 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.803157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.803855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.804128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.804427 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.805200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.806823 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.818512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1348/2716] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:13.828965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.839864 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eeded-d71f-4c74-88d8-618d9b33be4d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:13.844591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:13.846229 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:13.846720 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:13.847137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] PATH_INFO: `/v3/projects/7f4a309ee8c9437882bb938f7ab84a44/users/c9a3b19b9653400d9ce09e2b3f1f038c/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:13.864995 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a309ee8c9437882bb938f7ab84a44, user_id=c9a3b19b9653400d9ce09e2b3f1f038c, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:13.867682 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:13.944374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1369/2717] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:13 2022] PUT /identity/v3/projects/7f4a309ee8c9437882bb938f7ab84a44/users/c9a3b19b9653400d9ce09e2b3f1f038c/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:13.948601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:13.959832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809da5-66a3-481d-b62d-9747b084657b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:14.021332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:14.022100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:14.022409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:14.022746 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:14.023481 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:14.025111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e72db-5273-40ac-a885-6d87e6914bee admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:14.040562 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1349/2718] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:14.041399 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:14.052181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a936e-b2b4-4210-92b3-01e4a6f9889a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:14.056862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:14.057794 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:14.058082 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:14.058362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] PATH_INFO: `/v3/projects/7f4a309ee8c9437882bb938f7ab84a44/users/c9a3b19b9653400d9ce09e2b3f1f038c/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:14.060469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a309ee8c9437882bb938f7ab84a44, user_id=c9a3b19b9653400d9ce09e2b3f1f038c, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:14.063194 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:14.075699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1370/2719] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:14 2022] PUT /identity/v3/projects/7f4a309ee8c9437882bb938f7ab84a44/users/c9a3b19b9653400d9ce09e2b3f1f038c/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:14.087975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:14.088273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:14.088561 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:14.126986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] MFA Rules not processed for user `c9a3b19b9653400d9ce09e2b3f1f038c`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:14.128343 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:14.200778 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1350/2720] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:14.213476 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:14.275099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63929c-a71e-44c4-bed0-80c432312eb5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:14.278712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:14.279360 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:14.279646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:14.279926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:14.290727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:14.292086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b077be2-c0e7-458e-bb52-7cc97ec71681 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:14.301717 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1371/2721] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:15.519171 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:15.583888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6468bf-3bb1-4d36-a7a1-d83e216c8169 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:15.588885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:15.589815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:15.590132 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:15.590440 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] PATH_INFO: `/v3/users/1e8c1a519e28470b8b25013563463d9d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:15.591632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8c1a519e28470b8b25013563463d9d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:15.593641 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:15.600292 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:15.855600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8c1a519e28470b8b25013563463d9d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:15.863471 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8c1a519e28470b8b25013563463d9d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:15.864145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8c1a519e28470b8b25013563463d9d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:15.876737 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8c1a519e28470b8b25013563463d9d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:15.964370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8c1a519e28470b8b25013563463d9d'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:15.971797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1351/2722] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:15 2022] DELETE /identity/v3/users/1e8c1a519e28470b8b25013563463d9d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:15.976337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:15.976802 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:15.976929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:15.995849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:15.997113 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:16.062512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1372/2723] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:16.072417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:16.073999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:16.135426 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac886a-87de-4439-a79a-d75922b568df admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:16.139285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:16.139941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:16.140336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:16.140606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:16.151020 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:16.152466 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:16.164465 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1352/2724] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:16.638654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:16.640586 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:16.655711 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140c3a-bd36-4006-98de-dc29c2120ea6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:16.661801 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:16.665072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:16.665072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:16.665072 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] PATH_INFO: `/v3/projects/b9aba7a8544a4635bc1ddf1d5da5f416` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:16.666022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9aba7a8544a4635bc1ddf1d5da5f416)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:16.667932 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:16.668398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:16.669365 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:16.682405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa5bc-5a3b-459d-af4c-b0e0d7ac50f6 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:16.686981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:16.687847 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:16.688123 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:16.688417 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] PATH_INFO: `/v3/users/672513ad1b40416eb84e61431154a260` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:16.690278 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672513ad1b40416eb84e61431154a260)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:16.692202 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:16.817515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9aba7a8544a4635bc1ddf1d5da5f416', 'request_id': 'req-392f161c-a329-4980-9fac-794cf1709287'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.822992 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9aba7a8544a4635bc1ddf1d5da5f416', 'request_id': 'req-392f161c-a329-4980-9fac-794cf1709287'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.825464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:16.958461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9aba7a8544a4635bc1ddf1d5da5f416', 'request_id': 'req-392f161c-a329-4980-9fac-794cf1709287'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.970887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] The token cache is being invalidate because project b9aba7a8544a4635bc1ddf1d5da5f416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:16.971177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.971880 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.973472 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1373/2725] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:16 2022] DELETE /identity/v3/projects/b9aba7a8544a4635bc1ddf1d5da5f416 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:16.977503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:16.978534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672513ad1b40416eb84e61431154a260'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.980293 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:16.986873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672513ad1b40416eb84e61431154a260'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:16.987649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672513ad1b40416eb84e61431154a260'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.000166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672513ad1b40416eb84e61431154a260'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.047068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f161c-a329-4980-9fac-794cf1709287 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:17.357047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:17.357047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:17.357047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:17.357047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] PATH_INFO: `/v3/users/c9a3b19b9653400d9ce09e2b3f1f038c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:17.357503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a3b19b9653400d9ce09e2b3f1f038c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:17.357503 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-e3e4be19-f9ad-451b-964b-636f8209ed93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672513ad1b40416eb84e61431154a260'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1353/2726] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:16 2022] DELETE /identity/v3/users/672513ad1b40416eb84e61431154a260 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:17.357730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:17.358281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:17.358281 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:17.374875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1354/2727] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:17.384772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:17.386317 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:17.491893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a3b19b9653400d9ce09e2b3f1f038c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.492590 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a3b19b9653400d9ce09e2b3f1f038c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.500654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a3b19b9653400d9ce09e2b3f1f038c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.513724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a3b19b9653400d9ce09e2b3f1f038c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.572761 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd0e67-512b-4bb5-b74c-f66faab4e456 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:17.576630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:17.577264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:17.577548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:17.577850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:17.587538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:17.588912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:17.589357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a3b19b9653400d9ce09e2b3f1f038c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:17.596601 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1374/2728] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:16 2022] DELETE /identity/v3/users/c9a3b19b9653400d9ce09e2b3f1f038c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:17.600574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1355/2729] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:18.174850 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.176483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.208354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.210336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.226789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82144739-47a9-48b1-b75e-9745e1a62513 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.256391 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6692cb-e79e-4ac8-ad75-680286180c29 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.261356 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.262396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.262678 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.262961 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] PATH_INFO: `/v3/projects/7f4a309ee8c9437882bb938f7ab84a44` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.264171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4a309ee8c9437882bb938f7ab84a44)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.266135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.278704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:18.292564 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.293484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.293804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.294087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] PATH_INFO: `/v3/projects/5daea77cf42846cea24a7c66ce80a625` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.295316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5daea77cf42846cea24a7c66ce80a625)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.297307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.382817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4a309ee8c9437882bb938f7ab84a44', 'request_id': 'req-0084a512-28ef-4842-9589-edec66e396cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.388316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4a309ee8c9437882bb938f7ab84a44', 'request_id': 'req-0084a512-28ef-4842-9589-edec66e396cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.408914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:18.412412 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5daea77cf42846cea24a7c66ce80a625', 'request_id': 'req-ab572778-5977-471b-a09a-9e5c1f08d67f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.418772 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5daea77cf42846cea24a7c66ce80a625', 'request_id': 'req-ab572778-5977-471b-a09a-9e5c1f08d67f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.495653 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4a309ee8c9437882bb938f7ab84a44', 'request_id': 'req-0084a512-28ef-4842-9589-edec66e396cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.508786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] The token cache is being invalidate because project 7f4a309ee8c9437882bb938f7ab84a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:18.509069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.509819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0084a512-28ef-4842-9589-edec66e396cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.511402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1375/2730] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:18 2022] DELETE /identity/v3/projects/7f4a309ee8c9437882bb938f7ab84a44 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:18.517056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b864fe-31bf-4e87-ae61-d589781591f9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.517375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b864fe-31bf-4e87-ae61-d589781591f9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.517764 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b864fe-31bf-4e87-ae61-d589781591f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.536402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-31b864fe-31bf-4e87-ae61-d589781591f9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:18.537657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-31b864fe-31bf-4e87-ae61-d589781591f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.555096 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5daea77cf42846cea24a7c66ce80a625', 'request_id': 'req-ab572778-5977-471b-a09a-9e5c1f08d67f'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.567370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] The token cache is being invalidate because project 5daea77cf42846cea24a7c66ce80a625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:18.570484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.570484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.570484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1356/2731] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:18 2022] DELETE /identity/v3/projects/5daea77cf42846cea24a7c66ce80a625 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:18.574006 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.575373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.598570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1376/2732] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:18.611916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.612201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.612575 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.631403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:18.632680 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.641022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1377/2733] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:18.642144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572778-5977-471b-a09a-9e5c1f08d67f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.645415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.647245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.648175 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.648459 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.648739 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] PATH_INFO: `/v3/users/c41e699d2c7242f996868fe0a6a091b2` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.650290 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41e699d2c7242f996868fe0a6a091b2)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.652870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.654742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac83d0-d088-44d4-af2c-6492684c1d92 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.659523 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.660171 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.660539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.660732 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.661484 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:18.661822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.667960 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.675950 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1378/2734] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:23:18.680532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.691487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cf1e-bf64-44a8-ae84-ed6df458256a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.696132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.696834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.697119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.697397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.698110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.700023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.785034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1379/2735] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:18 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:18.789219 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.849137 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:18.853332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0056e-0031-4ad1-a167-950f528a4a61 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.858609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.863098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.863098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.863098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.863098 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.863505 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41e699d2c7242f996868fe0a6a091b2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.863611 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.869524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41e699d2c7242f996868fe0a6a091b2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.870264 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41e699d2c7242f996868fe0a6a091b2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.882754 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41e699d2c7242f996868fe0a6a091b2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.956025 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1380/2736] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:18 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:18.960217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.969879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79439-e0e2-423d-8a22-8b08ebddd78c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.975329 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.975993 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.976306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.976584 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.977306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.979012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.987979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41e699d2c7242f996868fe0a6a091b2'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:18.989934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1381/2737] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:18.993954 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.000810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.000947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1357/2738] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:18 2022] DELETE /identity/v3/users/c41e699d2c7242f996868fe0a6a091b2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:19.009464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba42a-9ce9-44da-b912-1457fc760282 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.068426 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.069103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.069392 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.069705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.070428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.072104 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecb533-ef55-4cb8-91f8-0c3924baa863 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.086135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1382/2739] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:19.089891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.098303 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e7517-5bbe-4e01-9754-3454055bf35b admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.102804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.103698 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.103979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.104253 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] PATH_INFO: `/v3/projects/b9abe46d97f04d4a896ed796f418c88b/users/564e1d8375334e8882df93fb441eed79/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.119517 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abe46d97f04d4a896ed796f418c88b, user_id=564e1d8375334e8882df93fb441eed79, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.122211 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.207470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1358/2740] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:19 2022] PUT /identity/v3/projects/b9abe46d97f04d4a896ed796f418c88b/users/564e1d8375334e8882df93fb441eed79/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:19.218198 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.218664 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.218766 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.251192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] MFA Rules not processed for user `564e1d8375334e8882df93fb441eed79`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:19.252615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.326481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1383/2741] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:19.331956 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.365260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:19.396113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fbd2-f6ed-4f97-bf22-d63ce97e2614 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.400925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.401607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.401886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.402164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.402844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.404797 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.465450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.466990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.484036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06e756-e2d5-4f47-a9ef-b7da0a9b40ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.489712 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.490609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.490996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.491214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] PATH_INFO: `/v3/projects/dbe87a5ce3694031a82e7a053e62b66d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.492557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe87a5ce3694031a82e7a053e62b66d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.494522 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.525605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1359/2742] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:19.527581 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.588318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def87c0-4f49-4db8-ba65-b8bcd2cb1a2f admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.593401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.594095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.596655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.596655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.596655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.597832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.609397 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe87a5ce3694031a82e7a053e62b66d', 'request_id': 'req-12f9ecf3-a095-4cac-a333-0f36aa3a697b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:19.614809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:19.616123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe87a5ce3694031a82e7a053e62b66d', 'request_id': 'req-12f9ecf3-a095-4cac-a333-0f36aa3a697b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:19.681324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1360/2743] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:19.685230 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.695647 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbae4-279b-4a7b-90d0-381bb6c8cddc admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.698101 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe87a5ce3694031a82e7a053e62b66d', 'request_id': 'req-12f9ecf3-a095-4cac-a333-0f36aa3a697b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:19.711620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] The token cache is being invalidate because project dbe87a5ce3694031a82e7a053e62b66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:19.711847 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:19.712517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12f9ecf3-a095-4cac-a333-0f36aa3a697b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:19.714126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1384/2744] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:19 2022] DELETE /identity/v3/projects/dbe87a5ce3694031a82e7a053e62b66d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:19.719296 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07899-5a81-4a10-bd9f-80284a374232 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.719589 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07899-5a81-4a10-bd9f-80284a374232 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.719873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07899-5a81-4a10-bd9f-80284a374232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.738265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-16a07899-5a81-4a10-bd9f-80284a374232 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:19.739492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16a07899-5a81-4a10-bd9f-80284a374232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.755870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.756547 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.756835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.757116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.758316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.763652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.772293 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1361/2745] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:19.776741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.778515 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.791148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2508c3-970a-4d0f-9ec2-c58d64ef111d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.797804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.797804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.797804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.797804 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] PATH_INFO: `/v3/projects/f9cb379c5dd547338cce236de11f674e/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.809106 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1385/2746] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:19.815346 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cb379c5dd547338cce236de11f674e, user_id=29f95d99eb0c4d9f9de7dabd9e0ca3ae, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.817883 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.818153 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.818506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.819006 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.839146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:19.840350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:19.848985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1386/2747] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:19.853088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.863232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e7c5e-7c73-4985-a891-f070cbe3cb55 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.868571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.869249 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.869531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.869838 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.870562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:19.870866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.872460 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.885658 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1387/2748] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:23:19.890855 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.902567 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9b7c-af22-43d5-9c4c-6a451325d92f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.908484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1362/2749] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:19 2022] PUT /identity/v3/projects/f9cb379c5dd547338cce236de11f674e/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:19.915201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:19.933554 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:19.964959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.965539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.965871 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.966459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.966849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.968780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:19.981398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f24190-4382-4304-a1f3-6b4146e8ec7e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:19.986954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:19.987638 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:19.987925 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:19.988207 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:19.988981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:19.990610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.000923 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1363/2750] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:20.005742 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.017277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24505d-0b94-4c04-a53f-de3ba1379676 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.022235 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.023141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.023428 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.023729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] PATH_INFO: `/v3/projects/f9cb379c5dd547338cce236de11f674e/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.025704 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cb379c5dd547338cce236de11f674e, user_id=29f95d99eb0c4d9f9de7dabd9e0ca3ae, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.028314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97820989-b617-4687-a363-5f5306e0fd5a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.038613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1364/2751] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:20 2022] PUT /identity/v3/projects/f9cb379c5dd547338cce236de11f674e/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:20.050630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.050920 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.051223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.079177 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] MFA Rules not processed for user `29f95d99eb0c4d9f9de7dabd9e0ca3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:20.080613 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:20.099945 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1388/2752] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:19 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:20.104068 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.154225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1365/2753] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:20.159942 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:20.170033 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.171396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:20.171588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6070116-82d5-4ccd-8a6c-ba25cd7ef066 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.176660 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.178049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.178342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.178621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.179320 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.181303 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.229968 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeb1ac-29a0-4003-8b70-a56cbbfd8d5e None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.269358 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:20.278515 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1389/2754] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:20 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:20.279630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.280767 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.281443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.281766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.282048 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.294851 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616724-c40c-4314-996a-1861c6f4f6c4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.300667 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.301335 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.301642 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.301919 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.302636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.304263 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.315067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1390/2755] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:20.318982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.328635 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bbc3a-8f8e-4dbc-a4b5-d42e83adce66 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.333931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.334593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.335126 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.335412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.336122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.337772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.350348 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1391/2756] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:20.353680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.359393 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.359527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc465-86d7-4957-a6dc-b046b739b53e service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.364512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25225c-694d-483a-a98d-b4ee78e98cf3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.365396 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1366/2757] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:20.369459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.370781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.371034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.371306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] PATH_INFO: `/v3/projects/81f8f96e110b420aba434be83113b6d9/users/87e6c6ee43194d06a9c9daae11248f93/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.388253 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f8f96e110b420aba434be83113b6d9, user_id=87e6c6ee43194d06a9c9daae11248f93, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.391004 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.498609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1392/2758] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:20 2022] PUT /identity/v3/projects/81f8f96e110b420aba434be83113b6d9/users/87e6c6ee43194d06a9c9daae11248f93/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:20.567203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.567386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.567652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.597497 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] MFA Rules not processed for user `87e6c6ee43194d06a9c9daae11248f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:20.598751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:20.672708 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1367/2759] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:20.673874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.740634 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9b2-1704-412c-9957-4a036af21155 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.745339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.746175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.746288 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.746743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.747330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.749276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.831043 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1393/2760] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:20 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:20.841276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.852116 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8809-886b-4397-9ddd-d8ee5983fd75 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.909321 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.909755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.910042 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.910325 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.911052 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.913067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:20.943456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:20.954469 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f3e49-6c96-4a6f-bca6-0c78102e5b6a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:20.959696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:20.960891 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:20.961332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:20.961464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] PATH_INFO: `/v3/users/564e1d8375334e8882df93fb441eed79` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:20.962781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=564e1d8375334e8882df93fb441eed79)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:20.964782 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.008675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1368/2761] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:20 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:21.012467 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.022539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31041-15e3-4931-9890-f62909f4ed30 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.027586 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.028247 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.028534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.028812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.029566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.031188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.033643 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:21.041982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1369/2762] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:21.048924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.062741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710077a-50e8-4c30-b739-dac5ae09a319 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.068543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.069323 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.069675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.069983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.070904 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.072688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.085976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1370/2763] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:23:21.090103 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.100701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b40c-cd0a-4f91-8ec4-2ca07811ea97 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.105512 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.106455 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.106735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.107114 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] PATH_INFO: `/v3/projects/b67526b269f84672b0a4ca66c3e7872e/users/a5180011cb5e400bb0eff97e3a210cfe/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.122289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67526b269f84672b0a4ca66c3e7872e, user_id=a5180011cb5e400bb0eff97e3a210cfe, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.124894 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e414a2-f84d-420e-be01-7b6aa588dc47 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.224703 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1371/2764] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:21 2022] PUT /identity/v3/projects/b67526b269f84672b0a4ca66c3e7872e/users/a5180011cb5e400bb0eff97e3a210cfe/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:21.234751 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.235038 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.235348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.264119 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] MFA Rules not processed for user `a5180011cb5e400bb0eff97e3a210cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:21.265273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:21.266024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564e1d8375334e8882df93fb441eed79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:21.266723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564e1d8375334e8882df93fb441eed79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:21.274434 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564e1d8375334e8882df93fb441eed79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:21.288277 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564e1d8375334e8882df93fb441eed79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:21.296644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:21.332922 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1372/2765] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:21.337709 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.389085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6803199e-e64e-4de7-89a3-d69fa73e25ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564e1d8375334e8882df93fb441eed79'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:21.395669 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1394/2766] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:20 2022] DELETE /identity/v3/users/564e1d8375334e8882df93fb441eed79 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:21.399494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba2b7-1336-4321-9a70-378c10b0c7db None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.400332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.400648 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.400982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.419457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:21.423693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:21.460567 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.461234 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.461527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.461830 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.462559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.464451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.484516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1395/2767] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:21.492654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:21.495149 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.496546 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:21.552931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2c1bd-5114-4ad0-b55a-0a7a1209d8f5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.556856 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.557499 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.557816 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.558091 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.560300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1373/2768] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:21 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:21.564363 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.567780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:21.568818 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.570290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.581005 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1396/2769] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:21.632341 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2836e0-609c-4a72-a36f-ddf408855194 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.637335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.638049 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.638332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.638605 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.639291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.641200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.736357 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1374/2770] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:21 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:23:21.740368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.750019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460952cf-7763-47a3-a111-7b176da122cd service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.755028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.755695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.756012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.756291 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.757074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.758709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.770081 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1397/2771] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:21.774329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.786068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444029-cb49-432a-9dc1-a9929dfe7f38 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.792060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.792961 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.793246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.793532 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] PATH_INFO: `/v3/projects/bdc31cce36d74ff99956c67ac3903ab3/users/358345c0020d42468adae22cc0c39f3a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.819938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc31cce36d74ff99956c67ac3903ab3, user_id=358345c0020d42468adae22cc0c39f3a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.822669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.890470 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1375/2772] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:21 2022] PUT /identity/v3/projects/bdc31cce36d74ff99956c67ac3903ab3/users/358345c0020d42468adae22cc0c39f3a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:21.895861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.905861 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25080cd4-afaf-4cf6-9725-a60568963966 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.965065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.965779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:21.966065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:21.966343 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:21.967059 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:21.968655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:21.978965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1398/2773] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:21.983228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:21.994198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b97481-a323-4359-9de7-bf2e6a9d8871 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:21.999057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:21.999939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:22.000226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:22.000506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] PATH_INFO: `/v3/projects/bdc31cce36d74ff99956c67ac3903ab3/users/358345c0020d42468adae22cc0c39f3a/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:22.002649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc31cce36d74ff99956c67ac3903ab3, user_id=358345c0020d42468adae22cc0c39f3a, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:22.007419 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bf7d2-0fde-4306-9dd1-97c14003a417 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:22.012154 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:22.014893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:22.023812 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1376/2774] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:21 2022] PUT /identity/v3/projects/bdc31cce36d74ff99956c67ac3903ab3/users/358345c0020d42468adae22cc0c39f3a/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:22.032868 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:22.033187 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:22.033457 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:22.035034 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e220d-07d4-464f-a59e-3216daa00d01 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:22.056170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.069370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] MFA Rules not processed for user `358345c0020d42468adae22cc0c39f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:22.069370 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:22.098903 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:22.099787 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:22.100076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:22.100398 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] PATH_INFO: `/v3/projects/b9abe46d97f04d4a896ed796f418c88b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:22.101665 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9abe46d97f04d4a896ed796f418c88b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:22.103684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:22.137493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1377/2775] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:22.149529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:22.150938 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:22.177393 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.209670 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b84d-487f-4159-98c8-7dcbe45e368f None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:22.213645 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:22.214369 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:22.214654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:22.214935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:22.216915 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:22.247458 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9abe46d97f04d4a896ed796f418c88b', 'request_id': 'req-2d356686-9558-410e-af78-fec8a00c88d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.253200 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9abe46d97f04d4a896ed796f418c88b', 'request_id': 'req-2d356686-9558-410e-af78-fec8a00c88d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.278528 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:22.280015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:22.290726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1378/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:22.333065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9abe46d97f04d4a896ed796f418c88b', 'request_id': 'req-2d356686-9558-410e-af78-fec8a00c88d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.355704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] The token cache is being invalidate because project b9abe46d97f04d4a896ed796f418c88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:22.355704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.355704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.355704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1399/2777] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:22 2022] DELETE /identity/v3/projects/b9abe46d97f04d4a896ed796f418c88b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:22.356122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:22.363688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb223f-36f4-45aa-bb6c-79246a04ffc9 service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:22.428980 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:22.430029 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:22.430314 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:22.430624 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] PATH_INFO: `/v3/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:22.431846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f95d99eb0c4d9f9de7dabd9e0ca3ae)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:22.433886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:22.688695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f95d99eb0c4d9f9de7dabd9e0ca3ae'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.696533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f95d99eb0c4d9f9de7dabd9e0ca3ae'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.697212 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f95d99eb0c4d9f9de7dabd9e0ca3ae'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.709678 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f95d99eb0c4d9f9de7dabd9e0ca3ae'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.713473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.784229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-296c35d1-8f81-4c31-b714-2fbaaaf22c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f95d99eb0c4d9f9de7dabd9e0ca3ae'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:22.791439 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1379/2778] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:22 2022] DELETE /identity/v3/users/29f95d99eb0c4d9f9de7dabd9e0ca3ae => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:23.277002 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:23.278532 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:23.293256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356686-9558-410e-af78-fec8a00c88d4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:23.350985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:23.351844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:23.352123 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:23.352405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] PATH_INFO: `/v3/projects/f9cb379c5dd547338cce236de11f674e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:23.353620 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cb379c5dd547338cce236de11f674e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:23.355543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:23.482022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cb379c5dd547338cce236de11f674e', 'request_id': 'req-5a259f62-e068-479e-aab6-4c128606d523'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:23.483946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:23.487752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cb379c5dd547338cce236de11f674e', 'request_id': 'req-5a259f62-e068-479e-aab6-4c128606d523'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:23.621278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cb379c5dd547338cce236de11f674e', 'request_id': 'req-5a259f62-e068-479e-aab6-4c128606d523'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:23.633242 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] The token cache is being invalidate because project f9cb379c5dd547338cce236de11f674e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:23.633538 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:23.634255 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a259f62-e068-479e-aab6-4c128606d523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:23.635852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1400/2779] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:23 2022] DELETE /identity/v3/projects/f9cb379c5dd547338cce236de11f674e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:23.640802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:23.641307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:23.641422 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:23.659122 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:23.660841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:23.723759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1380/2780] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:23.731563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:23.731887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:23.732167 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:23.762047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:23.763362 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:23.782481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1401/2781] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:23.787534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:23.797622 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89037a-d073-4510-a5b0-6ea19e3dbdd4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:23.802658 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:23.803373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:23.803661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:23.803941 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:23.804672 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:23.804981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:23.806607 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:23.818726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1381/2782] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:23:23.823065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:23.833124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e669b-d75d-4b39-bc8a-01a78f53d05c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:23.838169 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:23.838821 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:23.839105 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:23.839382 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:23.840076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:23.842044 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:23.938761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1402/2783] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:23 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:23.943306 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:23.997091 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e949143-590f-4a5f-8ca6-8a91516302ac admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.060201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.060907 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.061194 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.061473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.062301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.064217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.170676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1382/2784] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:23 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:24.174718 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.221318 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40357737-97db-4d0c-8256-4a43994fb413 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.226281 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.227237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.227237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.227526 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.228165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.229770 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.244368 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1403/2785] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:24.248730 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.259838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a670217-a747-4bed-9235-ed256b1912b9 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.264527 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.265188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.265478 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.265774 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.266649 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.268846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.280404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1383/2786] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:24.284741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.295456 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a84e-29f3-4d37-938c-fd3db80ac4e9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.303457 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.304704 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.305278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.305553 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] PATH_INFO: `/v3/projects/351f295f3be84c389cf2d6f51ee953e9/users/1fbde91577304ba4b1ef2f6f894b7cce/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.311719 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.313451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.323157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=351f295f3be84c389cf2d6f51ee953e9, user_id=1fbde91577304ba4b1ef2f6f894b7cce, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.326062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f90e-2f60-482e-9c62-753187dbdbaa admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.341266 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:24.391642 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0673b4-0948-4b1b-9d1b-517bc4627db7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.396228 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.396873 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.397224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.397598 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.402514 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.428346 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1404/2787] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:24 2022] PUT /identity/v3/projects/351f295f3be84c389cf2d6f51ee953e9/users/1fbde91577304ba4b1ef2f6f894b7cce/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:24.433412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948fd7c-74f8-4d03-bb78-4c8697260b8a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.433807 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948fd7c-74f8-4d03-bb78-4c8697260b8a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.434085 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948fd7c-74f8-4d03-bb78-4c8697260b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.461164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.461959 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6948fd7c-74f8-4d03-bb78-4c8697260b8a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:24.462681 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.463196 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6948fd7c-74f8-4d03-bb78-4c8697260b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.471836 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1384/2788] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:24.526466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1405/2789] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:24.537028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.538501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.598100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3d6c-4ec5-42a3-bb77-e83c35c0b93b service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.648398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.649087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.649332 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.649680 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.659432 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.661203 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.670999 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1385/2790] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:26.072763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.073235 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.073536 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.095674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:26.106157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] MFA Rules not processed for user `1fbde91577304ba4b1ef2f6f894b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:26.107692 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:26.189735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1406/2791] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:26.195143 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.211230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.211433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58ba4-5754-435e-92b2-d6bd354b6e66 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.213889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.214559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.214870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.215326 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.216032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.218026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.262654 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c40ac-e3f5-47e6-8916-3780f00b3f9c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.266350 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.266999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.267286 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.267563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.269464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:26.315790 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:26.323844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1386/2792] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:26 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:26.327985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.337240 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.338767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.349743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1407/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:26.394285 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc22fc-15cd-4094-a3d1-d85005473a22 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.399078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.399801 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.400089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.400368 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.401057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.403005 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.485351 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1387/2794] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:26 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:26.486529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.499493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edea93-da5c-4056-b77a-a941ac572952 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.505070 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.506300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.506594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.506874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.507596 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.509207 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.519551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1408/2795] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:26.524045 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.534082 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812775-457b-4891-9bc0-8ffe29a8fbbb admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.539180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.540067 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.540352 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.540628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] PATH_INFO: `/v3/projects/65a533ac0d2b4e709bae69b1addce1ae/users/d2ed122fd2bd459c82591b9545e32b7d/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.556705 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a533ac0d2b4e709bae69b1addce1ae, user_id=d2ed122fd2bd459c82591b9545e32b7d, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.559377 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.621876 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1388/2796] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:26 2022] PUT /identity/v3/projects/65a533ac0d2b4e709bae69b1addce1ae/users/d2ed122fd2bd459c82591b9545e32b7d/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:26.625887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.636874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a0c8-d7c5-42b6-a0d1-2cbd130d7950 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.692848 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.693512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.693967 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.694213 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.694879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.696569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c654c5-8b66-4e72-8ffc-0b1b9f5eaf53 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.707047 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1409/2797] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:26.711319 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:26.721879 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049d48-744b-4673-992a-d12b1fedb707 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:26.726576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:26.730893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:26.730893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:26.730893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] PATH_INFO: `/v3/projects/65a533ac0d2b4e709bae69b1addce1ae/users/d2ed122fd2bd459c82591b9545e32b7d/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:26.730893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a533ac0d2b4e709bae69b1addce1ae, user_id=d2ed122fd2bd459c82591b9545e32b7d, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:26.732589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e467cc-146a-4804-a656-e3df5961ea16 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:26.744087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1389/2798] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:26 2022] PUT /identity/v3/projects/65a533ac0d2b4e709bae69b1addce1ae/users/d2ed122fd2bd459c82591b9545e32b7d/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:27.099150 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:28.181572 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:28.182119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:28.182314 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:28.213394 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] MFA Rules not processed for user `d2ed122fd2bd459c82591b9545e32b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:28.214710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:28.299570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1410/2799] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:28.312444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:28.312444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:28.312444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:28.330784 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] MFA Rules not processed for user `1fbde91577304ba4b1ef2f6f894b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:28.332504 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:28.390921 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1390/2800] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:28.404192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:28.405640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:28.517562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e35cd5-05f2-4156-b16f-951c8ca23856 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:28.523612 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:28.524260 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:28.524540 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:28.524810 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:28.532671 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:28.534290 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03fb2c-46b5-4f80-a00c-041eb7d377a5 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:28.544646 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1411/2801] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:31.012994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:31.014495 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:31.077633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:31.083444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aced69-fd38-4477-beef-3cfbbfc7c458 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:31.088347 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:31.089218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:31.089498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:31.089820 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] PATH_INFO: `/v3/users/87e6c6ee43194d06a9c9daae11248f93` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:31.091017 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e6c6ee43194d06a9c9daae11248f93)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:31.092958 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:31.339095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e6c6ee43194d06a9c9daae11248f93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:31.346548 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e6c6ee43194d06a9c9daae11248f93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:31.348167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e6c6ee43194d06a9c9daae11248f93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:31.360914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e6c6ee43194d06a9c9daae11248f93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:31.459078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e6c6ee43194d06a9c9daae11248f93'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:31.466668 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1391/2802] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:31 2022] DELETE /identity/v3/users/87e6c6ee43194d06a9c9daae11248f93 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:31.471019 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:31.471559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:31.471696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:31.491262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:31.492723 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:31.505227 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:31.553925 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1412/2803] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:31.564891 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:31.566993 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:31.637280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10c3f-7dd0-46cb-b296-b3557855b28a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:31.641149 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:31.642084 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:31.642201 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:31.642444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:31.653618 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:31.655057 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:31.667901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1392/2804] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:32.147089 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:32.148554 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:32.160843 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614412e7-4082-44c0-b6aa-459389a5f701 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:32.165471 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:32.166407 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:32.166729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:32.167160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] PATH_INFO: `/v3/projects/81f8f96e110b420aba434be83113b6d9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:32.168414 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f8f96e110b420aba434be83113b6d9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:32.170427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:32.283103 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f8f96e110b420aba434be83113b6d9', 'request_id': 'req-8fc05fbc-596f-486a-874b-d65d3f015db5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.289944 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f8f96e110b420aba434be83113b6d9', 'request_id': 'req-8fc05fbc-596f-486a-874b-d65d3f015db5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.421163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f8f96e110b420aba434be83113b6d9', 'request_id': 'req-8fc05fbc-596f-486a-874b-d65d3f015db5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.433157 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] The token cache is being invalidate because project 81f8f96e110b420aba434be83113b6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:32.433528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.434214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.435758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1413/2805] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:32 2022] DELETE /identity/v3/projects/81f8f96e110b420aba434be83113b6d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:32.440039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:32.451241 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e4227-84e0-4bb6-b2a5-b24ab1dabece service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:32.514087 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:32.514976 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:32.515258 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:32.515525 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] PATH_INFO: `/v3/users/a5180011cb5e400bb0eff97e3a210cfe` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:32.516832 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5180011cb5e400bb0eff97e3a210cfe)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:32.519423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:32.553348 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:32.730283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5180011cb5e400bb0eff97e3a210cfe'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.737335 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5180011cb5e400bb0eff97e3a210cfe'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.738676 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5180011cb5e400bb0eff97e3a210cfe'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.751782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5180011cb5e400bb0eff97e3a210cfe'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.881437 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5180011cb5e400bb0eff97e3a210cfe'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:32.889738 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1393/2806] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:32 2022] DELETE /identity/v3/users/a5180011cb5e400bb0eff97e3a210cfe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:33.369421 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:33.371212 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:33.392593 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05fbc-596f-486a-874b-d65d3f015db5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:33.460512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:33.460512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:33.460512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:33.460512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] PATH_INFO: `/v3/projects/b67526b269f84672b0a4ca66c3e7872e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:33.461468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67526b269f84672b0a4ca66c3e7872e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:33.463427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:33.625075 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:33.630069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67526b269f84672b0a4ca66c3e7872e', 'request_id': 'req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.636681 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67526b269f84672b0a4ca66c3e7872e', 'request_id': 'req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.724396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67526b269f84672b0a4ca66c3e7872e', 'request_id': 'req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.735862 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] The token cache is being invalidate because project b67526b269f84672b0a4ca66c3e7872e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:33.736153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.736781 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.738404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1414/2807] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:33 2022] DELETE /identity/v3/projects/b67526b269f84672b0a4ca66c3e7872e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:33.742442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:33.743859 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:33.756885 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43f14-59a9-4b4b-9102-8bdf88e2f7a6 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:33.814260 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:33.815068 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:33.815353 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:33.816146 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] PATH_INFO: `/v3/users/358345c0020d42468adae22cc0c39f3a` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:33.817565 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358345c0020d42468adae22cc0c39f3a)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:33.819519 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:33.992108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358345c0020d42468adae22cc0c39f3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:33.999342 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358345c0020d42468adae22cc0c39f3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:34.000055 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358345c0020d42468adae22cc0c39f3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:34.013225 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358345c0020d42468adae22cc0c39f3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:34.080792 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-80c0fcf6-9e41-491d-ae77-4513176cdf92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358345c0020d42468adae22cc0c39f3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:34.092031 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1394/2808] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:33 2022] DELETE /identity/v3/users/358345c0020d42468adae22cc0c39f3a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:34.785153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:34.786724 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:34.799863 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf937d-4bb1-46f4-82e2-b15ee396cebb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:34.875687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:34.876804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:34.877090 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:34.877364 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] PATH_INFO: `/v3/projects/bdc31cce36d74ff99956c67ac3903ab3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:34.879464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc31cce36d74ff99956c67ac3903ab3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:34.881610 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.058804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc31cce36d74ff99956c67ac3903ab3', 'request_id': 'req-6c63f24e-b990-45a2-90f5-5deb25f23436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:35.064294 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc31cce36d74ff99956c67ac3903ab3', 'request_id': 'req-6c63f24e-b990-45a2-90f5-5deb25f23436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:35.130625 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc31cce36d74ff99956c67ac3903ab3', 'request_id': 'req-6c63f24e-b990-45a2-90f5-5deb25f23436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:35.142599 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] The token cache is being invalidate because project bdc31cce36d74ff99956c67ac3903ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:35.143012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:35.144230 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6c63f24e-b990-45a2-90f5-5deb25f23436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:35.146039 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1415/2809] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:34 2022] DELETE /identity/v3/projects/bdc31cce36d74ff99956c67ac3903ab3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:35.151311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.151789 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.151888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.174556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:35.190124 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:35.192131 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:35.251134 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1395/2810] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:35.259375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.259668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.259952 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.278750 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:35.280001 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:35.288822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1416/2811] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:35.293094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.303539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59bf58-9ae6-4fa7-8c30-71a47da48b9a None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.308224 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.308880 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.309158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.309431 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.310188 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:35.310494 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.312080 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.323871 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1396/2812] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:23:35.328261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.338099 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c0fd6-4b93-4ee4-9a54-ff8b4692a02d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.342938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.343591 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.343873 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.344146 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.344841 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.346774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.448531 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1417/2813] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:35 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:35.452982 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.464213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2f1c-210c-482a-84a0-f0fca2e63250 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.524037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.524621 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.524912 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.525192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.525935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.527867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.662533 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1397/2814] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:35 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:35.666693 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.677780 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e7b3e-5f95-46a1-8396-86829b0bbf06 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.682355 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.683021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.683337 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.683615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.684332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.685965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.696876 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1418/2815] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:35.701893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.712897 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298dbe6-bd3d-42ff-8b77-02c5ca9d2485 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.717652 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.718316 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.718606 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.718889 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.719619 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.721223 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d9d3c-74f3-4aa7-9bec-266dfe528adc admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.732056 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1398/2816] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:35.736238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.746425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d693c-7de7-4820-88fc-ed7fd8ea2107 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:35.751030 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:35.751897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.752177 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.752449 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] PATH_INFO: `/v3/projects/b07189b87aa04bac89944dca4387cd68/users/4d50eb44d8fc4195bf321be28ef95ccc/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.766985 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07189b87aa04bac89944dca4387cd68, user_id=4d50eb44d8fc4195bf321be28ef95ccc, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:35.770256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:35.824558 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:35.830248 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1419/2817] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:35 2022] PUT /identity/v3/projects/b07189b87aa04bac89944dca4387cd68/users/4d50eb44d8fc4195bf321be28ef95ccc/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:35.841520 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:35.841857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:35.842172 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:35.870066 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] MFA Rules not processed for user `4d50eb44d8fc4195bf321be28ef95ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:35.871305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:35.930461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:35.940136 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1399/2818] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:35.951221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:35.954973 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:36.013853 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5404aee-dce8-4c1c-a9fc-71a0979deea6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:36.018100 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:36.019274 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:36.019562 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:36.019839 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:36.030020 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:36.031638 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:36.041790 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1420/2819] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:43.345416 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:43.347423 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:43.359414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7646c-6e3d-4f58-bdad-ed4417e2d3be None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:43.363959 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:43.364633 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:43.364919 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:43.365195 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:43.367108 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:43.435942 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:43.437371 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:43.447951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1400/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:46.037547 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=27 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:47.301639 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:47.339687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:47.341200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:47.368779 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efd84-b6fc-4fa4-8daa-274600755485 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:47.373644 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:47.374549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:47.374833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:47.375109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] PATH_INFO: `/v3/users/4d50eb44d8fc4195bf321be28ef95ccc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:47.376365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d50eb44d8fc4195bf321be28ef95ccc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:47.378404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:47.441817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce088c9c-3752-4c2a-a69f-35f43f046a2d service cinder] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:47.446995 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:47.447644 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:47.447928 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:47.448213 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:47.450109 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:47.462994 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:47.464559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad9f2c-0754-4b69-8677-b116de502df2 service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:47.474831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1401/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:47.609237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d50eb44d8fc4195bf321be28ef95ccc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:47.609922 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d50eb44d8fc4195bf321be28ef95ccc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:47.617687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d50eb44d8fc4195bf321be28ef95ccc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:47.632631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d50eb44d8fc4195bf321be28ef95ccc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:47.709539 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d50eb44d8fc4195bf321be28ef95ccc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:47.716269 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1421/2822] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:47 2022] DELETE /identity/v3/users/4d50eb44d8fc4195bf321be28ef95ccc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:47.720974 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:47.721320 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:47.721653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:47.745933 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:47.747760 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:47.807556 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=100 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:47.817975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1402/2823] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:47.826804 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:47.828190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:47.915304 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd533f-03a3-4854-8902-f0ccf26e26bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:47.919168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:47.919846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:47.920124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:47.920431 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:47.930760 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:47.932197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f64d2a-05be-4add-8d0b-7844aee73355 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:47.943185 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1422/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:48.608529 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:48.610307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:48.623558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1eb4-c512-47ba-ae0e-de0e95af33da None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:48.628398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:48.629890 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:48.630179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:48.630981 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] PATH_INFO: `/v3/projects/b07189b87aa04bac89944dca4387cd68` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:48.631863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07189b87aa04bac89944dca4387cd68)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:48.634121 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:48.771183 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07189b87aa04bac89944dca4387cd68', 'request_id': 'req-48bc6d54-dbfc-4707-845b-f277b8df7909'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:48.777687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07189b87aa04bac89944dca4387cd68', 'request_id': 'req-48bc6d54-dbfc-4707-845b-f277b8df7909'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:48.860975 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07189b87aa04bac89944dca4387cd68', 'request_id': 'req-48bc6d54-dbfc-4707-845b-f277b8df7909'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:48.872896 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] The token cache is being invalidate because project b07189b87aa04bac89944dca4387cd68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:48.873181 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:48.873850 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-48bc6d54-dbfc-4707-845b-f277b8df7909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:48.875409 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1403/2825] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:48 2022] DELETE /identity/v3/projects/b07189b87aa04bac89944dca4387cd68 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:23:48.880869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:48.881363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:48.881459 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:48.888416 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:48.901430 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:48.902849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:48.965506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1423/2826] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:48.975254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:48.975545 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:48.975828 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:48.995461 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:48.996688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:49.004741 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1404/2827] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:49.008974 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.019694 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eb2f-6ea5-4441-be93-773bd915b303 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.024860 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.025520 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.025846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.026125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.026881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:23:49.027190 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.028849 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.043083 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1424/2828] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:23:49.047414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.057667 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a5e0e-c0cb-4529-8d0c-ee0f145ff607 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.062451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.063113 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.063397 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.063675 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.064380 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.066388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.185442 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1405/2829] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:23:49 2022] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:49.189516 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.200559 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55c432-3766-4c17-8822-507d8842fa64 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.259636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.260315 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.260627 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.260906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.261632 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.263616 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.411784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1425/2830] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:23:49 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:23:49.415028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.426572 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129543f-0624-480a-b99a-11206189b4c1 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.431176 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.431838 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.432127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.432405 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.433127 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.434799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.445632 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1406/2831] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:49.449881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.461080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca46b-c910-4fce-a618-280065599681 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.466055 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.466746 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.467027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.467328 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.468080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.469774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ab483-357d-460b-9be9-0a63e0df16c5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.481053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1426/2832] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:23:49.485256 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.495786 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5500afd-e0a2-49bd-8543-595dfa18f6de admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.500271 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.501151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.501430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.501758 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] PATH_INFO: `/v3/projects/086a7b00d58a4c42ba5b8546cad07f8d/users/2c27089c7dac484ab6454c5738b5317f/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.517141 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086a7b00d58a4c42ba5b8546cad07f8d, user_id=2c27089c7dac484ab6454c5738b5317f, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.520453 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.793446 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1407/2833] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:23:49 2022] PUT /identity/v3/projects/086a7b00d58a4c42ba5b8546cad07f8d/users/2c27089c7dac484ab6454c5738b5317f/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:49.805617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.805899 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.806327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.838898 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] MFA Rules not processed for user `2c27089c7dac484ab6454c5738b5317f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:49.840135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:49.904502 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:49.910193 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1427/2834] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:49.922300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.924443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:50.003250 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06b9c-a581-469c-a9ac-c3059359fec4 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:50.007654 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:50.008300 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:50.008582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:50.008863 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:50.017254 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:50.018715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb22f7b-f0e4-444a-b5eb-415d4cbc0dcf service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:50.028166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1408/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:23:56.278563 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:56.344285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23ca29-54f4-4048-ad54-b7c0cbf7747e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:56.348774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:56.349666 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:56.349972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:56.350250 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] PATH_INFO: `/v3/users/2c27089c7dac484ab6454c5738b5317f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:56.352062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c27089c7dac484ab6454c5738b5317f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:56.354023 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:56.597752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c27089c7dac484ab6454c5738b5317f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:56.598401 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c27089c7dac484ab6454c5738b5317f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:56.606080 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c27089c7dac484ab6454c5738b5317f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:56.618939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c27089c7dac484ab6454c5738b5317f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:56.691784 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c27089c7dac484ab6454c5738b5317f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:56.698834 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1428/2836] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:23:56 2022] DELETE /identity/v3/users/2c27089c7dac484ab6454c5738b5317f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:23:56.703717 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:56.706669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:56.706669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:56.710659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:56.722609 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:56.723822 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:56.784617 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1409/2837] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:56.795170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:56.796887 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:56.856994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6477-d5dc-4413-b90f-4b45276eae22 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:56.860687 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:56.861349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:56.861725 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:56.862010 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:56.872556 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:56.874046 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:56.884752 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1429/2838] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:57.339726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:57.341197 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:57.354627 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca0d1-9c37-4b52-9cba-ab94cfb94d3c None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:57.359521 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:57.360450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:57.361305 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:57.361826 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] PATH_INFO: `/v3/projects/086a7b00d58a4c42ba5b8546cad07f8d` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:57.363062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=086a7b00d58a4c42ba5b8546cad07f8d)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:57.365028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:57.522886 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086a7b00d58a4c42ba5b8546cad07f8d', 'request_id': 'req-da3c2959-b0e6-4433-b24c-46cdf9171e1e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:57.529276 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086a7b00d58a4c42ba5b8546cad07f8d', 'request_id': 'req-da3c2959-b0e6-4433-b24c-46cdf9171e1e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:57.649399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086a7b00d58a4c42ba5b8546cad07f8d', 'request_id': 'req-da3c2959-b0e6-4433-b24c-46cdf9171e1e'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:57.660887 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] The token cache is being invalidate because project 086a7b00d58a4c42ba5b8546cad07f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:23:57.661180 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:57.668174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:23:57.668174 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1410/2839] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:23:57 2022] DELETE /identity/v3/projects/086a7b00d58a4c42ba5b8546cad07f8d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:06.879767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:07.657689 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:08.748256 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:08.749844 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:08.763852 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167f09-3a86-4cc2-ae4e-53221a716df8 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:08.822737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:08.823619 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:08.823906 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:08.824192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] PATH_INFO: `/v3/users/1fbde91577304ba4b1ef2f6f894b7cce` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:08.825598 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbde91577304ba4b1ef2f6f894b7cce)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:08.827631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:09.064450 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbde91577304ba4b1ef2f6f894b7cce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.067703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbde91577304ba4b1ef2f6f894b7cce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.072366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbde91577304ba4b1ef2f6f894b7cce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.084270 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbde91577304ba4b1ef2f6f894b7cce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.177323 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbde91577304ba4b1ef2f6f894b7cce'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.184383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1430/2840] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:08 2022] DELETE /identity/v3/users/1fbde91577304ba4b1ef2f6f894b7cce => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:09.454307 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:09.456216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:09.471340 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2959-b0e6-4433-b24c-46cdf9171e1e admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:09.529773 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:09.530631 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:09.530911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:09.531277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] PATH_INFO: `/v3/projects/351f295f3be84c389cf2d6f51ee953e9` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:09.532435 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=351f295f3be84c389cf2d6f51ee953e9)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:09.534373 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:09.653499 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351f295f3be84c389cf2d6f51ee953e9', 'request_id': 'req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.659694 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351f295f3be84c389cf2d6f51ee953e9', 'request_id': 'req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.726367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351f295f3be84c389cf2d6f51ee953e9', 'request_id': 'req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.737566 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] The token cache is being invalidate because project 351f295f3be84c389cf2d6f51ee953e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:09.737888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.738539 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:09.740065 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1411/2841] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:09 2022] DELETE /identity/v3/projects/351f295f3be84c389cf2d6f51ee953e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:09.744912 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:09.746424 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:09.759404 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5050925-7788-43ac-b18c-5bf3c1cc6cc9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:09.818826 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:09.819714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:09.819996 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:09.820276 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] PATH_INFO: `/v3/users/d2ed122fd2bd459c82591b9545e32b7d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:09.821836 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ed122fd2bd459c82591b9545e32b7d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:09.823792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:09.846765 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:10.069202 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ed122fd2bd459c82591b9545e32b7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.069895 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ed122fd2bd459c82591b9545e32b7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.077997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ed122fd2bd459c82591b9545e32b7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.091162 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ed122fd2bd459c82591b9545e32b7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.183480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f24d94a2-abb0-44b2-88c9-0c6b39f099f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ed122fd2bd459c82591b9545e32b7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.190237 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1431/2842] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:09 2022] DELETE /identity/v3/users/d2ed122fd2bd459c82591b9545e32b7d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:10.448448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:10.450125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:10.464339 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad822d0-f6b1-4c1e-ad40-beacadc32d3a admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:10.528573 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:10.529450 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:10.529766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:10.530050 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] PATH_INFO: `/v3/projects/65a533ac0d2b4e709bae69b1addce1ae` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:10.531318 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a533ac0d2b4e709bae69b1addce1ae)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:10.533277 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:10.644447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:10.657291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a533ac0d2b4e709bae69b1addce1ae', 'request_id': 'req-1c17a1c7-0b21-4419-8b41-410ef5193274'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.663433 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a533ac0d2b4e709bae69b1addce1ae', 'request_id': 'req-1c17a1c7-0b21-4419-8b41-410ef5193274'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.747128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a533ac0d2b4e709bae69b1addce1ae', 'request_id': 'req-1c17a1c7-0b21-4419-8b41-410ef5193274'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.759311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] The token cache is being invalidate because project 65a533ac0d2b4e709bae69b1addce1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:10.759614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.760301 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-1c17a1c7-0b21-4419-8b41-410ef5193274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:10.762782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1412/2843] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:10 2022] DELETE /identity/v3/projects/65a533ac0d2b4e709bae69b1addce1ae => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:10.769334 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:10.769932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:10.769932 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:10.787965 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:10.789192 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:10.851468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1432/2844] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:10.859315 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:10.859924 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:10.860411 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:10.879969 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:10.881208 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:10.890927 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1413/2845] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:10.895262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:10.906727 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183b61b-5b94-4b06-9e63-477faf2b5e15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:10.911076 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:10.911737 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:10.912022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:10.912300 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:10.913021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:24:10.913327 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:10.914972 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:10.927012 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1433/2846] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:24:10.931589 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:10.941571 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77cab7-974b-42a5-a3c1-ea9b3d5803d4 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:10.946218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:10.946875 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:10.947162 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:10.947475 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:10.948819 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:10.950807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.060569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1414/2847] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:24:10 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:11.065609 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:11.076994 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249c3e-5dab-41e9-9114-f56335e35abd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:11.136506 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:11.137181 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.137468 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.137845 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.138478 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:11.140493 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.281631 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1434/2848] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:24:11 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:11.285688 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:11.296600 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973e93-7cef-481a-8af9-027de072db80 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:11.301115 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:11.301813 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.302106 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.302388 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.303117 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:11.304722 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.315883 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1415/2849] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:11.320022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:11.331289 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af50b78-fe34-4b21-83d8-e7b4d923cf5a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:11.336184 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:11.336846 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.337134 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.337415 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.338176 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:11.340029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fded1bb-8984-4f81-b437-f41bf280582d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.350978 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1435/2850] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:11.355726 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:11.365817 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949a01-8099-4e29-8eaa-98b4f59a2567 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:11.371081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:11.377695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.377695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.377695 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] PATH_INFO: `/v3/projects/b59dc0adee864104bdc1ba7029990952/users/121082e023f14f44aef2016eb0db4ffd/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.387226 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59dc0adee864104bdc1ba7029990952, user_id=121082e023f14f44aef2016eb0db4ffd, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:11.389909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.521179 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1416/2851] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:24:11 2022] PUT /identity/v3/projects/b59dc0adee864104bdc1ba7029990952/users/121082e023f14f44aef2016eb0db4ffd/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:11.526918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f42a1-231b-43fb-947a-d97bc8ad93c2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.527247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f42a1-231b-43fb-947a-d97bc8ad93c2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.527524 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f42a1-231b-43fb-947a-d97bc8ad93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.534715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:11.546267 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-219f42a1-231b-43fb-947a-d97bc8ad93c2 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:11.547466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-219f42a1-231b-43fb-947a-d97bc8ad93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:11.608582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1436/2852] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:11.618262 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:11.620078 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:11.680130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70905-5f24-4652-a157-c009682e0b36 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:11.683906 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:11.684550 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:11.684831 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:11.685105 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:11.694770 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:11.696186 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:11.705696 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1417/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:13.166056 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b848-f0d9-449e-8ae8-8ff9b2ed619f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:13.168040 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b848-f0d9-449e-8ae8-8ff9b2ed619f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:13.168622 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b848-f0d9-449e-8ae8-8ff9b2ed619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:13.196896 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1c10b848-f0d9-449e-8ae8-8ff9b2ed619f None None] MFA Rules not processed for user `121082e023f14f44aef2016eb0db4ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:13.198311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1c10b848-f0d9-449e-8ae8-8ff9b2ed619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:13.268582 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1437/2854] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:24:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:13.279846 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:13.281273 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:13.339086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566aa7-7533-492e-9478-a8bf859bc023 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:13.342844 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad61a2fb834e31b4a6f6df2f023e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:13.343496 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:13.343782 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:13.344062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:13.352401 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:13.354821 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907cb44-1e6f-45b1-86e6-16daa28919b8 service cinder] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:13.363905 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1418/2855] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:15.207998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:15.208518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:15.208518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:15.226968 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] MFA Rules not processed for user `121082e023f14f44aef2016eb0db4ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:15.228178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:15.235332 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1438/2856] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:24:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:23.359835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:25.221487 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=60 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:50.611265 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9a1e-192e-4c02-a4f9-d99b1702ba88 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:50.611867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9a1e-192e-4c02-a4f9-d99b1702ba88 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:50.611867 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9a1e-192e-4c02-a4f9-d99b1702ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:50.630558 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-8a2d9a1e-192e-4c02-a4f9-d99b1702ba88 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:50.631783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8a2d9a1e-192e-4c02-a4f9-d99b1702ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:50.641635 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1419/2857] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:50.671165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:50.672574 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:50.748701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275af6-bd63-447b-9831-49733807cfc4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:50.754371 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:50.755016 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:50.755295 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:50.755570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:50.764915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:50.766517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:50.776763 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1439/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:54.860291 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e1e5a-b589-4ae5-b505-2a77d067f5df None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:54.860979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e1e5a-b589-4ae5-b505-2a77d067f5df None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:54.860979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e1e5a-b589-4ae5-b505-2a77d067f5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:54.879987 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-471e1e5a-b589-4ae5-b505-2a77d067f5df None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:54.881198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-471e1e5a-b589-4ae5-b505-2a77d067f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:54.890095 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1420/2859] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:54.912576 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:54.914078 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:54.929561 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1391-37a9-4abc-83b7-1b95473c69bf service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:54.935947 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:54.936600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:54.936888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:54.937186 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:54.946461 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:54.948931 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:54.959916 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1440/2860] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:58.476901 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2168cc-0081-45bc-a35c-7187b5dff03c None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:58.477484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2168cc-0081-45bc-a35c-7187b5dff03c None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:58.477484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2168cc-0081-45bc-a35c-7187b5dff03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:58.498684 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-9c2168cc-0081-45bc-a35c-7187b5dff03c None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:58.499893 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-9c2168cc-0081-45bc-a35c-7187b5dff03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:58.507802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1421/2861] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:58.531696 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:58.544640 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae47a-413a-4b4f-8c17-872efc0f1c61 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:58.550735 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:58.551411 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:58.551701 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:58.551977 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:58.561823 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:58.563466 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:58.575119 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1441/2862] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:01.215570 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a4bb-2e2f-425d-8b49-6ae122a8323f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:01.216166 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a4bb-2e2f-425d-8b49-6ae122a8323f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:01.216279 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a4bb-2e2f-425d-8b49-6ae122a8323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:01.236330 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-32a9a4bb-2e2f-425d-8b49-6ae122a8323f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:01.237535 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-32a9a4bb-2e2f-425d-8b49-6ae122a8323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:01.245874 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1422/2863] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:01.277909 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:01.289483 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bce8-7bb7-4a71-8a88-30015ececc3e service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:01.295623 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:01.296262 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:01.296543 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:01.296819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:01.305470 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:01.307064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:01.317197 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1442/2864] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:04.459574 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71677718-ef28-425a-affa-af5108d6b63f None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:04.460157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71677718-ef28-425a-affa-af5108d6b63f None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:04.460157 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71677718-ef28-425a-affa-af5108d6b63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:04.479460 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-71677718-ef28-425a-affa-af5108d6b63f None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:04.481538 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-71677718-ef28-425a-affa-af5108d6b63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:04.490763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1423/2865] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:04.520165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:04.532214 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9f44-a9d5-48e0-b2e1-247ac00c5000 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:04.537703 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:04.538342 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:04.538742 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:04.539028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:04.548052 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:04.549729 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:04.560375 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1443/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:07.652037 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c5e7-756d-4c3b-9485-98b474745ba9 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:07.652861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c5e7-756d-4c3b-9485-98b474745ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:07.652861 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c5e7-756d-4c3b-9485-98b474745ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:07.671229 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-ae75c5e7-756d-4c3b-9485-98b474745ba9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:07.672541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-ae75c5e7-756d-4c3b-9485-98b474745ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:07.683464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1424/2867] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:07.715427 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:07.727201 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33490-2635-44e8-9c55-8e8a5afda1a0 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:07.733110 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:07.733786 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:07.734074 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:07.734359 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:07.745221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:07.746966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:07.757417 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1444/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:17.665718 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=18 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:17.752605 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=64 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.050857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.051448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.051448 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.069125 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] MFA Rules not processed for user `121082e023f14f44aef2016eb0db4ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:25.078954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.078954 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1425/2869] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:25.316228 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.317822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.330714 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec380e-e091-4ee1-8a52-57ac33b9149a service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.336325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.336325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.336325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.336325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.337743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.348221 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.349670 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.357943 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1445/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:33.661287 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:33.672523 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97a3ac-6559-46b9-b50f-d26a400017d2 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:33.677112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:33.677815 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.678099 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.678379 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.680217 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:33.695944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:33.697612 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7abb-728f-4566-9f6d-820590030847 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:33.710130 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1426/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:34.903066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.912829 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e97b8-467b-4eff-9a5e-ab3d43feeb6b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.916662 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.917321 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.917630 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.917999 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.919966 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:34.936390 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:34.937866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:34.950657 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1446/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:43.581979 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48828-a2cd-42cf-9530-4875028b1822 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.582541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48828-a2cd-42cf-9530-4875028b1822 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.582541 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48828-a2cd-42cf-9530-4875028b1822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.601199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-66b48828-a2cd-42cf-9530-4875028b1822 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.602444 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-66b48828-a2cd-42cf-9530-4875028b1822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.611835 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1427/2873] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:43.650183 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.662051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bd5e-9345-4b89-a527-39d57969b97a service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.668168 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.668806 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.669087 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.669365 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.677777 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.679339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.688651 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1447/2874] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:47.098026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3892d-3414-4557-9156-8a3279515baa None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.098625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3892d-3414-4557-9156-8a3279515baa None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.098625 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3892d-3414-4557-9156-8a3279515baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.117493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-d5c3892d-3414-4557-9156-8a3279515baa None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:47.118766 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-d5c3892d-3414-4557-9156-8a3279515baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:47.126877 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1428/2875] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:47.150302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.162419 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b7ba-1556-42e8-8e44-88962a7a0f06 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.168065 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.168699 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.168983 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.169261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.177929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.179518 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.190283 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1448/2876] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:50.015498 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bcf65-4eab-42a4-bdc9-a9e256b680ed None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.016036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bcf65-4eab-42a4-bdc9-a9e256b680ed None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.016036 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bcf65-4eab-42a4-bdc9-a9e256b680ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.022336 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=16 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.034992 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-205bcf65-4eab-42a4-bdc9-a9e256b680ed None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:50.036199 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-205bcf65-4eab-42a4-bdc9-a9e256b680ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:50.045404 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1429/2877] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:50.077395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.083530 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=25 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.090373 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfaf8-6b49-443c-808f-4f97672076cb service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.096127 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.096783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.097064 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.097341 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.106232 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.107822 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.117544 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1449/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:53.267126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190459db-139c-454c-afbe-6b7b9ab85cbf None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.267736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190459db-139c-454c-afbe-6b7b9ab85cbf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.267736 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190459db-139c-454c-afbe-6b7b9ab85cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.287060 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-190459db-139c-454c-afbe-6b7b9ab85cbf None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:53.288280 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-190459db-139c-454c-afbe-6b7b9ab85cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:53.296569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1430/2879] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:53.318767 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.331302 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fc47-1396-4a54-af8f-0b60943fe001 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.343285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.343285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.343285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.343285 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.347774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.349347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.359349 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1450/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:56.587559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.587559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.587559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.588337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.589390 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.598100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1431/2881] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:56.630163 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.642125 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9180af-5998-45b1-86da-ac6aa015c135 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.647926 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.648608 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.648897 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.649238 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.658278 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.661948 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.669441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1451/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:26:06.582237 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=8 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.665165 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=17 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.303161 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.315204 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742dedc-f217-4d2d-9b57-4305c2911b39 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.319857 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.320723 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.321660 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.321937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] PATH_INFO: `/v3/users/121082e023f14f44aef2016eb0db4ffd` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.323272 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] RBAC: Authorizing `identity:delete_user(user_id=121082e023f14f44aef2016eb0db4ffd)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.325205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.514205 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121082e023f14f44aef2016eb0db4ffd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:29.521364 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121082e023f14f44aef2016eb0db4ffd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:29.522111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121082e023f14f44aef2016eb0db4ffd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:29.534580 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121082e023f14f44aef2016eb0db4ffd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:29.613167 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-925f5d01-1b26-4005-9254-096306ce672c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121082e023f14f44aef2016eb0db4ffd'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:29.619962 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1432/2883] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:26:29 2022] DELETE /identity/v3/users/121082e023f14f44aef2016eb0db4ffd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:29.886837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.897517 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204c84-994b-4388-9ab2-640ee1229500 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.967153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.968027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.968308 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.968621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] PATH_INFO: `/v3/projects/b59dc0adee864104bdc1ba7029990952` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.969927 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59dc0adee864104bdc1ba7029990952)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.971833 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.106247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59dc0adee864104bdc1ba7029990952', 'request_id': 'req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:30.112528 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59dc0adee864104bdc1ba7029990952', 'request_id': 'req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:30.190036 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59dc0adee864104bdc1ba7029990952', 'request_id': 'req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:30.202672 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] The token cache is being invalidate because project b59dc0adee864104bdc1ba7029990952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:26:30.202962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:30.203715 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43d1d882-c71b-4ebf-a3bf-dbf4895fd8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:30.205357 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1452/2884] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:26:29 2022] DELETE /identity/v3/projects/b59dc0adee864104bdc1ba7029990952 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:30.210687 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.210985 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.211283 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.230686 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:30.231892 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:30.295034 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1433/2885] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:26:30.357412 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.357774 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.358086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.376819 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:30.378124 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:30.387330 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1453/2886] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:30.393164 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.403888 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10cf5-36dd-46f0-8f97-885d2f3df4d9 None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.408451 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.409107 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.409386 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.409701 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.410443 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:30.410743 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.412329 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.424576 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1434/2887] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:30.428938 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.438805 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ef4d-cd44-443a-b7f2-c669d50c5e13 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.443551 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.444170 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.444621 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.444902 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.445607 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.448042 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.629247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1454/2888] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:26:30 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:30.634026 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.644236 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508cabb-7b04-4a60-9293-863cc8cabce7 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.702246 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.702834 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.703118 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.703395 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.704081 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.706015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.715939 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.819337 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1435/2889] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:26:30 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:30.823668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.834643 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04829-69a3-436a-949e-0c3debc9a7c4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.839840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.840507 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.840792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.841069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.841825 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.843422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.855021 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1455/2890] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:26:30.859148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.870585 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144414e-b61b-4a76-9631-f8596ef37eaa admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.875354 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.876028 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.876311 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.876592 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.877322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.878998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302eb95-3c5c-45e9-a445-9ce945584443 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.890534 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1436/2891] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:26:30.894600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.906309 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53c0b-4d19-4330-af44-45320d14db0e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.910874 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.911788 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.912067 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.912339 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] PATH_INFO: `/v3/projects/cc1c8ec08d0147d4b9692aa10e3dbc23/users/700ddf0d6ec94dedb7ce041383bce0ab/roles/fb91a1eacf104c9ba3b62a4193b75e97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.929445 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1c8ec08d0147d4b9692aa10e3dbc23, user_id=700ddf0d6ec94dedb7ce041383bce0ab, role_id=fb91a1eacf104c9ba3b62a4193b75e97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.932438 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.017178 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1456/2892] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:26:30 2022] PUT /identity/v3/projects/cc1c8ec08d0147d4b9692aa10e3dbc23/users/700ddf0d6ec94dedb7ce041383bce0ab/roles/fb91a1eacf104c9ba3b62a4193b75e97 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:31.022415 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660bf3c-58fc-44ff-aba0-20fc369fdaf7 None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.022715 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660bf3c-58fc-44ff-aba0-20fc369fdaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.022998 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660bf3c-58fc-44ff-aba0-20fc369fdaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.041546 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-2660bf3c-58fc-44ff-aba0-20fc369fdaf7 None None] MFA Rules not processed for user `2bcd8937417c4772a105e4b213816e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:31.042911 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-2660bf3c-58fc-44ff-aba0-20fc369fdaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.104501 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1437/2893] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:31.114428 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.116152 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.137987 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.176049 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83acb-04bb-42d7-9377-76337cc4395e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.180102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.181316 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.181772 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.182053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.191934 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:31.193492 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.205571 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1457/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:26:36.432240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.432841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.432841 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.467240 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.auth.core [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] MFA Rules not processed for user `700ddf0d6ec94dedb7ce041383bce0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:36.468630 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:36.549158 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1438/2895] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:36.553686 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.564674 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c287-7cb7-4309-839b-5f54e438cd7b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.570311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.571333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.571615 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.571893 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.572636 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.574679 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.655439 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1458/2896] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Jul 11 14:26:36 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:26:36.659543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.671231 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22784-8b18-4081-9b87-984fc66efddf None None] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.736145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.736909 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] REQUEST_METHOD: `POST` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.737216 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.737493 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] PATH_INFO: `/v3/users` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.738221 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.740137 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.806286 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.811870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1439/2897] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Jul 11 14:26:36 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:36.815857 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.826464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7e07-03d8-4708-be95-87a589947195 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.831051 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.831705 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.831989 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.832261 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.833217 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.834888 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.846454 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1459/2898] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:26:36.850588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.861473 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08026d4c-f678-41ed-b5f3-32e6b59be23d admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.865986 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.866870 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.867394 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.867951 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] PATH_INFO: `/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97/users/41ac427bb84643569a590d4cb764ea08/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.883661 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e93e339f0b4a76803c53c6e7e6ff97, user_id=41ac427bb84643569a590d4cb764ea08, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.886367 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.954744 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1440/2899] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:26:36 2022] PUT /identity/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97/users/41ac427bb84643569a590d4cb764ea08/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:36.958866 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.969783 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869e42-ebb0-4873-bcba-d9f6c77183d3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.026425 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.027109 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.027396 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.027677 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.028402 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.030062 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f66ce-e689-4f81-8784-4dce7a3f3fa7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.040915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1460/2900] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:26:37.045542 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.056356 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445fb3-f75e-4131-a1fa-bacd2f59f7c3 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.061383 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.062299 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.062590 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.062944 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] PATH_INFO: `/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97/users/41ac427bb84643569a590d4cb764ea08/roles/8a17c9667c6f4151aa26d4dbece282ef` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.064937 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e93e339f0b4a76803c53c6e7e6ff97, user_id=41ac427bb84643569a590d4cb764ea08, role_id=8a17c9667c6f4151aa26d4dbece282ef)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.067610 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.078464 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1441/2901] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Jul 11 14:26:37 2022] PUT /identity/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97/users/41ac427bb84643569a590d4cb764ea08/roles/8a17c9667c6f4151aa26d4dbece282ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:26:42.817817 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070607-44a9-4006-b4e2-2e12cdbe06bf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.818374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070607-44a9-4006-b4e2-2e12cdbe06bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.818374 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae070607-44a9-4006-b4e2-2e12cdbe06bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.847813 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ae070607-44a9-4006-b4e2-2e12cdbe06bf None None] MFA Rules not processed for user `41ac427bb84643569a590d4cb764ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:42.849066 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ae070607-44a9-4006-b4e2-2e12cdbe06bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:42.937333 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1461/2902] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:42.949071 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.950983 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:43.035506 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0718b-9f92-47b1-9f41-e831f0bcc935 admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.041058 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.041755 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.042039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.042312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.100799 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.103079 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.112150 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1442/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:26:45.738879 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.739403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.739512 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.762437 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] MFA Rules not processed for user `700ddf0d6ec94dedb7ce041383bce0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:45.763761 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:45.771160 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1462/2904] 10.222.0.60 () {58 vars in 957 bytes} [Mon Jul 11 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:53.107935 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.753955 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.546430 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.548010 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:02.627656 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30b4b-34ab-4278-bf6c-1c38795bf4ec service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.632655 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.633297 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.633602 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.633914 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.636425 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:02.648601 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.650474 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.660802 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1443/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:06.630366 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.640758 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:06.690325 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc2ea3-eba1-49b0-a8fa-d58ceea351df None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.694092 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.694741 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.695027 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.695306 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.697668 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:06.708132 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.709565 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.718069 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1463/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:27:07.590288 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.591899 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:07.615765 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b6cc5-519d-4265-9c78-b298edfbedc8 service placement] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.622072 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.622735 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.623018 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.623296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.625062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:07.639763 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.641490 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.653659 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1444/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:13.892423 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.906161 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a50a8-8d12-46bf-9a26-0a47cc729e48 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.911832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.912486 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.912809 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.913088 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.914969 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:13.928441 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.931569 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.943684 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1464/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:16.635085 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.644780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e7963-6834-4d51-9d29-309fb9905215 service nova] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.648381 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.649015 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.649296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.649569 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.658747 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.660160 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.670309 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1445/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:18.811594 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.823265 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a996-0b87-4d9b-8ae6-62c9d2c3f3b7 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.830173 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e0aca394e4f40c38b3f2db655c462f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.830832 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.831122 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.831403 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.833479 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:18.846698 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.848284 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.859918 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1465/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:26.665350 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=44 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.854557 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=38 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.582245 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:29.593692 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977619a-e27a-4d7b-ad25-a6cd7e857748 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.599441 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.600111 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.600398 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.600679 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.602486 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:29.614903 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:29.616487 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:29.626731 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1446/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:29:31.098939 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.109033 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032c00-5b56-40ce-8cde-fbda2e0b0431 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.112748 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.113405 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.113728 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.114013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.115869 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:31.126153 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.128121 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.136792 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1466/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:29:31.221780 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.231582 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c62cb1-a16d-48d8-9b36-d489003f7b6b service placement] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.235210 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.235854 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.236200 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.237100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.242086 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:31.256895 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.258359 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.269543 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1447/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:29:41.132908 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:41.264484 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=12 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:56.011743 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:56.021144 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef34115-d388-4c70-9f3b-eba0243e3b7e service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:56.024881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:56.025529 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:56.025859 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:56.026135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:56.029095 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:56.043881 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:56.045756 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:56.057247 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1467/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:30:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:30:57.239973 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:30:57.249148 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feb08e-a6b0-4201-bbe4-3944e4f769b5 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:30:57.252824 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be8d3204196494f9acc8cdf258c2458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:30:57.253524 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:57.253807 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:57.254089 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:57.255855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:30:57.270296 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:30:57.272074 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:30:57.285947 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1448/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:04.677422 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:04.688997 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635c93a-cf69-40da-bb15-7c47246d03d9 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:04.694086 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:04.694745 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:04.695028 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:04.695311 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:04.697102 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:04.710395 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:04.711981 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:04.724600 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1468/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:31:07.280198 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=6 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:08.423855 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.436289 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9aaa7-9602-47b8-825d-25049b24b144 service neutron] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.441447 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.442144 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] REQUEST_METHOD: `GET` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.442434 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.442712 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.444568 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:08.462145 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.463759 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.475077 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1449/2917] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:08.573175 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:08.641383 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13d0-0e96-405d-91b5-0a4e8e1b1928 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:08.645837 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:08.646716 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:08.646998 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:08.647282 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] PATH_INFO: `/v3/users/700ddf0d6ec94dedb7ce041383bce0ab` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:08.648481 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700ddf0d6ec94dedb7ce041383bce0ab)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:08.650455 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:08.952655 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700ddf0d6ec94dedb7ce041383bce0ab'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:08.953344 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700ddf0d6ec94dedb7ce041383bce0ab'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:08.960722 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700ddf0d6ec94dedb7ce041383bce0ab'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:08.973239 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700ddf0d6ec94dedb7ce041383bce0ab'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.035347 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700ddf0d6ec94dedb7ce041383bce0ab'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.042029 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1469/2918] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:31:08 2022] DELETE /identity/v3/users/700ddf0d6ec94dedb7ce041383bce0ab => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:09.293913 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:09.306032 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c4c84-e307-4e6d-bf7d-a316861144b6 service placement] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:09.372449 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:09.373324 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.373637 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.374039 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] PATH_INFO: `/v3/projects/cc1c8ec08d0147d4b9692aa10e3dbc23` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.375151 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1c8ec08d0147d4b9692aa10e3dbc23)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:09.377100 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:09.508753 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1c8ec08d0147d4b9692aa10e3dbc23', 'request_id': 'req-09c5f72d-1b1d-431f-9d19-7b563761d9fb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.516062 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1c8ec08d0147d4b9692aa10e3dbc23', 'request_id': 'req-09c5f72d-1b1d-431f-9d19-7b563761d9fb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.595312 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1c8ec08d0147d4b9692aa10e3dbc23', 'request_id': 'req-09c5f72d-1b1d-431f-9d19-7b563761d9fb'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.607653 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] The token cache is being invalidate because project cc1c8ec08d0147d4b9692aa10e3dbc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:31:09.607949 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.608614 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.610218 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1450/2919] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:31:09 2022] DELETE /identity/v3/projects/cc1c8ec08d0147d4b9692aa10e3dbc23 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:09.614570 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:09.616022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:09.629480 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670274d-14bf-4c63-a573-cb0c4684b301 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:09.678962 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:09.688915 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:09.689830 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.691022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.691022 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] PATH_INFO: `/v3/users/41ac427bb84643569a590d4cb764ea08` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.691617 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ac427bb84643569a590d4cb764ea08)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:09.693549 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:09.859975 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ac427bb84643569a590d4cb764ea08'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.860840 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ac427bb84643569a590d4cb764ea08'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.869464 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ac427bb84643569a590d4cb764ea08'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.883111 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ac427bb84643569a590d4cb764ea08'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.944135 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ac427bb84643569a590d4cb764ea08'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:09.951647 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1470/2920] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Jul 11 14:31:09 2022] DELETE /identity/v3/users/41ac427bb84643569a590d4cb764ea08 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:10.236559 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Authenticating user token {{(pid=80400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:10.239322 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.fernet_utils [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:10.252192 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f72d-1b1d-431f-9d19-7b563761d9fb admin admin] Validating token access rules against request {{(pid=80400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:10.313126 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bcd8937417c4772a105e4b213816e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '860ed82bdecd4cd588b102fbafc7b011', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:10.314025 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:10.314310 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] SCRIPT_NAME: `/identity` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:10.314588 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] PATH_INFO: `/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97` {{(pid=80400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:10.315783 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e93e339f0b4a76803c53c6e7e6ff97)` {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:10.317729 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] RBAC: Authorization granted {{(pid=80400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:10.341399 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:10.418865 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e93e339f0b4a76803c53c6e7e6ff97', 'request_id': 'req-2575e777-b99f-4f4b-86b0-d578784b48af'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:10.425669 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e93e339f0b4a76803c53c6e7e6ff97', 'request_id': 'req-2575e777-b99f-4f4b-86b0-d578784b48af'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:10.521002 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e93e339f0b4a76803c53c6e7e6ff97', 'request_id': 'req-2575e777-b99f-4f4b-86b0-d578784b48af'} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:10.533112 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] The token cache is being invalidate because project c7e93e339f0b4a76803c53c6e7e6ff97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:31:10.533414 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:10.534094 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG keystone.notifications [None req-2575e777-b99f-4f4b-86b0-d578784b48af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:31:10.535628 dv-cinder-848429-3-smb devstack@keystone.service[80400]: [pid: 80400|app: 0|req: 1451/2921] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Jul 11 14:31:10 2022] DELETE /identity/v3/projects/c7e93e339f0b4a76803c53c6e7e6ff97 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:31:19.946946 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:20.530128 dv-cinder-848429-3-smb devstack@keystone.service[80400]: DEBUG dbcounter [-] [80400] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:46.275588 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:46.277013 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:46.418929 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0767f-04bf-4be3-b2e0-0b29dc8e3b94 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:46.477024 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06e6c97215674774b1bbb18cfde54df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85c6d5fe72544ba5a9a5b34b39ddf7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:46.477709 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:46.477990 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:46.478259 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:46.480053 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:46.492363 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:46.493982 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf058c-3331-4609-aaac-b99b16235919 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:46.504695 dv-cinder-848429-3-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1471/2922] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:56.499710 dv-cinder-848429-3-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}